Apr 16 19:41:46 devstack cinder-volume[72830]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 16 19:41:46 devstack cinder-volume[72830]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 16 19:41:46 devstack cinder-volume[72830]: we strongly recommend against using it for new projects.
Apr 16 19:41:46 devstack cinder-volume[72830]: If you are already using Eventlet, we recommend migrating to a different
Apr 16 19:41:46 devstack cinder-volume[72830]: framework.  For more detail see
Apr 16 19:41:46 devstack cinder-volume[72830]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 16 19:41:46 devstack cinder-volume[72830]:   import eventlet  # noqa
Apr 16 19:41:48 devstack cinder-volume[72830]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72830) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 19:41:48 devstack cinder-volume[72830]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72830) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 19:41:48 devstack cinder-volume[72830]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72830) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 19:41:49 devstack cinder-volume[72830]: INFO dbcounter [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Registered counter for database cinder
Apr 16 19:41:49 devstack cinder-volume[72830]: DEBUG oslo_db.sqlalchemy.engines [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72830) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 19:41:49 devstack cinder-volume[72830]: DEBUG dbcounter [-] [72830] Writer thread running {{(pid=72830) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 16 19:41:49 devstack cinder-volume[72830]: INFO cinder.rpc [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 16 19:41:49 devstack cinder-volume[72830]: INFO cinder.rpc [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 16 19:41:49 devstack cinder-volume[72830]: DEBUG oslo_db.sqlalchemy.engines [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72830) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 19:41:49 devstack cinder-volume[72830]: INFO cinder.volume.manager [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Determined volume DB was empty at startup.
Apr 16 19:41:49 devstack cinder-volume[72830]: DEBUG cinder.volume.manager [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72830) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 16 19:41:49 devstack cinder-volume[72830]: INFO cinder.volume.manager [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 16 19:41:49 devstack cinder-volume[72830]: WARNING stevedore.named [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 16 19:41:49 devstack cinder-volume[72830]: WARNING castellan.key_manager [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 19:41:49 devstack cinder-volume[72830]: WARNING cinder.keymgr.conf_key_mgr [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 19:41:49 devstack cinder-volume[72830]: DEBUG cinder.volume.drivers.lvm [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72830) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 16 19:41:49 devstack cinder-volume[72830]: DEBUG oslo_concurrency.processutils [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72830) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_concurrency.processutils [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.375s {{(pid=72830) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_db.sqlalchemy.engines [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72830) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 19:41:50 devstack cinder-volume[72830]: INFO cinder.rpc [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 16 19:41:50 devstack cinder-volume[72830]: INFO cinder.rpc [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 16 19:41:50 devstack cinder-volume[72830]: WARNING stevedore.named [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 16 19:41:50 devstack cinder-volume[72830]: WARNING castellan.key_manager [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 19:41:50 devstack cinder-volume[72830]: INFO cinder.volume.manager [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_db.sqlalchemy.engines [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72830) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 19:41:50 devstack cinder-volume[72830]: INFO oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Starting 1 workers
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Started child 72941 {{(pid=72830) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Full set of CONF: {{(pid=72830) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] ******************************************************************************** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Configuration options gathered from: {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] ================================================================================ {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] allow_availability_zone_fallback = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] allow_compression_on_image_upload = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] allowed_direct_url_schemes     = [] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] api_rate_limit                 = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] auth_strategy                  = keystone {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] az_cache_duration              = 3600 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_availability_zone      = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_host                   = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_name                   = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_stats_polling_interval = 60 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backup_api_class               = cinder.backup.api.API {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backup_name_template           = backup-%s {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backup_use_same_host           = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backup_use_temp_snapshot       = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] chap_password                  = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] chap_username                  =  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cinder_internal_tenant_project_id = 80e217e0d8334912a6fcd1a3f120d09b {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cinder_internal_tenant_user_id = da401ea1aef64647904fba7dae53f5a1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cloned_volume_same_az          = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cluster                        = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] compression_format             = gzip {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] config_dir                     = [] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] config_source                  = [] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72941]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] control_exchange               = openstack {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] debug                          = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] default_availability_zone      = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] default_group_type             = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] default_volume_type            = lvmdriver-1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] disk_geometry                  = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] driver_client_cert             = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] driver_client_cert_key         = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] driver_data_namespace          = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] driver_ssl_cert_path           = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] driver_ssl_cert_verify         = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] driver_use_ssl                 = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] enable_force_upload            = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] enable_new_services            = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] enable_unsupported_driver      = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] enforce_multipath_for_image_xfer = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] filter_function                = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance_api_insecure            = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance_api_servers             = ['http://192.168.122.140/image'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance_api_ssl_compression     = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance_ca_certificates_file    = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance_certfile                = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance_keyfile                 = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance_num_retries             = 3 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance_request_timeout         = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] goodness_function              = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] graceful_shutdown_timeout      = 5 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] group_api_class                = cinder.group.api.API {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] host                           = devstack {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72941]: INFO cinder.volume.manager [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] image_compress_on_upload       = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] image_conversion_address_space_limit = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] image_conversion_cpu_limit     = 60 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] image_conversion_disable       = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] image_upload_use_cinder_backend = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] image_upload_use_internal_tenant = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] image_volume_cache_enabled     = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] image_volume_cache_max_count   = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] image_volume_cache_max_size_gb = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] init_host_max_objects_retrieval = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] iscsi_target_flags             =  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] iscsi_write_cache              = on {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] iser_helper                    = tgtadm {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] iser_ip_address                = 192.168.122.140 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] iser_port                      = 3260 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] log_color                      = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] log_config_append              = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] log_dir                        = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] log_file                       = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] log_options                    = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] log_rotate_interval            = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] log_rotate_interval_type       = days {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] log_rotation_type              = none {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] max_age                        = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] max_logfile_count              = 30 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] max_logfile_size_mb            = 200 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] max_over_subscription_ratio    = 20.0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] message_reap_interval          = 86400 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] message_ttl                    = 2592000 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] migration_create_volume_timeout_secs = 300 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] monkey_patch                   = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] monkey_patch_modules           = [] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] my_ip                          = 192.168.122.140 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] no_snapshot_gb_quota           = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] num_iser_scan_tries            = 3 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] num_shell_tries                = 3 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] num_volume_device_scan_tries   = 3 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] nvmeof_conn_info_version       = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] nvmet_ns_id                    = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] nvmet_port_id                  = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] osapi_max_limit                = 1000 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] osapi_volume_ext_list          = [] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] osapi_volume_listen_port       = 8776 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] osapi_volume_use_ssl           = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] osapi_volume_workers           = 2 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] per_volume_size_limit          = -1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] periodic_fuzzy_delay           = 60 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] periodic_interval              = 60 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] public_endpoint                = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] publish_errors                 = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] quota_backup_gigabytes         = 1000 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] quota_backups                  = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] quota_gigabytes                = 1000 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] quota_groups                   = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] quota_snapshots                = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] quota_volumes                  = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] rate_limit_burst               = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] rate_limit_except_level        = CRITICAL {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] rate_limit_interval            = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] reinit_driver_count            = 3 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] replication_device             = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] report_discard_supported       = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] report_interval                = 120 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] reservation_clean_interval     = 86400 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] reservation_expire             = 86400 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] reserved_image_namespaces      = [] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] reserved_percentage            = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] rpc_response_timeout           = 120 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] run_external_periodic_tasks    = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] scst_target_driver             = iscsi {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] scst_target_iqn_name           = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] service_down_time              = 720 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] shell_completion               = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] snapshot_name_template         = snapshot-%s {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] snapshot_same_host             = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] split_loggers                  = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] state_path                     = /opt/stack/data/cinder {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] storage_availability_zone      = nova {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] storage_protocol               = iSCSI {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] syslog_log_facility            = LOG_USER {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] target_helper                  = lioadm {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] target_ip_address              = 192.168.122.140 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] target_port                    = 3260 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] target_protocol                = iscsi {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] target_secondary_ip_addresses  = [] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] trace_flags                    = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] transport_url                  = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] until_refresh                  = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] use_chap_auth                  = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] use_default_quota_class        = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] use_journal                    = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] use_json                       = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] use_multipath_for_image_xfer   = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] use_stderr                     = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] use_syslog                     = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] verify_glance_signatures       = enabled {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] volume_api_class               = cinder.volume.api.API {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] volume_backend_name            = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] volume_clear                   = zero {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] volume_clear_ionice            = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] volume_clear_size              = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] volume_copy_bps_limit          = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] volume_dd_blocksize            = 1M {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] volume_name_template           = volume-%s {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] volume_service_inithost_offload = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] volume_usage_audit_period      = month {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] zoning_mode                    = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_concurrency.disable_process_locking = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.admin_password = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.admin_token = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.admin_user  = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.auth_protocol = https {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.auth_section = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.auth_type   = password {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.auth_uri    = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.auth_version = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.cache       = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.certfile    = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.identity_uri = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.include_service_catalog = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.insecure    = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.interface   = public {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.keyfile     = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_password =  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcache_username =  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.region_name = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.service_type = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:50 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.backend                  = dogpile.cache.null {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.backend_argument         = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.backend_expiration_time  = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.config_prefix            = cache.oslo {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.debug_cache_backend      = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.enable_retry_client      = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.enable_socket_keepalive  = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.enabled                  = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.enforce_fips_mode        = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.expiration_time          = 600 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.hashclient_retry_attempts = 2 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.memcache_dead_retry      = 300 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.memcache_sasl_enabled    = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.password                 = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.proxies                  = [] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.redis_db                 = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.redis_server             = localhost:6379 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.retry_attempts           = 2 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.retry_delay              = 0.0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.socket_keepalive_count   = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.socket_keepalive_idle    = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.socket_keepalive_interval = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.socket_timeout           = 1.0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.tls_allowed_ciphers      = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack sudo[72975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.tls_cafile               = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack sudo[72975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.tls_certfile             = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.tls_enabled              = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.tls_keyfile              = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cache.username                 = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] coordination.backend_url       = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.asyncio_connection    = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.asyncio_slave_connection = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.backend               = sqlalchemy {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.connection            = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.connection_debug      = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.connection_parameters =  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.connection_recycle_time = 3600 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.connection_trace      = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.db_inc_retry_interval = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.db_max_retries        = 20 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.db_max_retry_interval = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.db_retry_interval     = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.max_overflow          = 50 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.max_pool_size         = 5 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.max_retries           = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.mysql_wsrep_sync_wait = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.pool_timeout          = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.retry_interval        = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.slave_connection      = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.sqlite_synchronous    = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.synchronous_reader    = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] database.use_db_reconnect      = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler.connection_string     = messaging:// {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler.enabled               = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler.es_doc_type           = notification {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler.es_scroll_size        = 10000 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler.es_scroll_time        = 2m {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler.filter_error_trace    = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler.hmac_keys             = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler.sentinel_service_name = mymaster {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler.socket_timeout        = 0.1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler.trace_requests        = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler.trace_sqlalchemy      = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler_jaeger.process_tags   = {} {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler_jaeger.service_name_prefix = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] profiler_otlp.service_name_prefix = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_policy.enforce_new_defaults = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: WARNING oslo_config.cfg [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_policy.enforce_scope      = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_policy.policy_default_rule = default {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] privsep_osbrick.group          = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] privsep_osbrick.helper_command = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] privsep_osbrick.user           = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cinder_sys_admin.group         = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cinder_sys_admin.helper_command = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] cinder_sys_admin.user          = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] service_user.auth_section      = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] service_user.auth_type         = password {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] service_user.cafile            = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] service_user.certfile          = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] service_user.collect_timing    = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] service_user.insecure          = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] service_user.keyfile           = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] service_user.send_service_user_token = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] service_user.split_loggers     = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] service_user.timeout           = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance.auth_section            = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance.auth_type               = password {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance.certfile                = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance.collect_timing          = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance.insecure                = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance.keyfile                 = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance.region_name             = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance.split_loggers           = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] glance.timeout                 = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.backend_availability_zone = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.chap_password = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.chap_username =  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.disk_geometry = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.driver_client_cert = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.driver_client_cert_key = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.driver_data_namespace = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.driver_use_ssl = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.extra_capabilities = {} {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.filter_function = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.goodness_function = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.iscsi_target_flags =  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.iscsi_write_cache = on {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.iser_port     = 3260 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.lvm_share_target = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.lvm_type      = auto {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.num_shell_tries = 3 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.replication_device = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.report_discard_supported = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.reserved_percentage = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.target_helper = tgtadm {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.target_port   = 3260 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.target_protocol = iscsi {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.trace_flags   = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.unique_fqdn_network = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.use_chap_auth = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.volume_backend_name = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.volume_clear  = zero {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.volume_clear_ionice = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.volume_clear_size = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_reports.file_event_handler = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_reports.log_dir           = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.backend_host       = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.chap_password      = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.chap_username      = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.disk_geometry      = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.driver_client_cert = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.extra_capabilities = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.filter_function    = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.goodness_function  = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.iser_helper        = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.iser_port          = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.lvm_type           = auto {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.replication_device = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.report_discard_supported = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.reserved_percentage = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.scst_target_driver = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.storage_protocol   = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.target_ip_address  = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.target_port        = 3260 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.trace_flags        = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.volume_clear       = zero {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] lvmdriver-1.volumes_dir        = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_notifications.driver = [] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_notifications.retry = -1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] key_manager.fixed_key          = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.barbican_api_version  = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.barbican_endpoint     = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.barbican_endpoint_type = public {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.barbican_region_name  = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.cafile                = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.certfile              = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.collect_timing        = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.insecure              = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.keyfile               = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.number_of_retries     = 60 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.retry_delay           = 1 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.send_service_user_token = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.split_loggers         = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.timeout               = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.verify_ssl            = True {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican.verify_ssl_path       = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican_service_user.auth_section = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican_service_user.auth_type = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican_service_user.cafile   = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican_service_user.certfile = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican_service_user.collect_timing = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican_service_user.insecure = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican_service_user.keyfile  = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican_service_user.split_loggers = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] barbican_service_user.timeout  = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] vault.approle_role_id          = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] vault.approle_secret_id        = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] vault.kv_mountpoint            = secret {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] vault.kv_path                  = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] vault.kv_version               = 2 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] vault.namespace                = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] vault.root_token_id            = **** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] vault.ssl_ca_crt_file          = None {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] vault.timeout                  = 60.0 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] vault.use_ssl                  = False {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:41:50 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] ******************************************************************************** {{(pid=72830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 16 19:41:51 devstack sudo[72975]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:51 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:51 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:51 devstack sudo[73250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 19:41:51 devstack sudo[73250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:51 devstack sudo[73250]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:51 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.566s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:51 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:41:51 devstack cinder-volume[72941]: INFO cinder.brick.local_dev.lvm [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 16 19:41:51 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:51 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:51 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:51 devstack sudo[73435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 19:41:51 devstack sudo[73435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:52 devstack sudo[73435]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:52 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.548s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:52 devstack cinder-volume[72941]: DEBUG cinder.brick.local_dev.lvm [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72941) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 16 19:41:52 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:52 devstack sudo[73471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 19:41:52 devstack sudo[73471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:53 devstack sudo[73471]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:53 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.892s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:53 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:53 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:53 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:53 devstack sudo[73630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 19:41:53 devstack sudo[73630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:53 devstack sudo[73630]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:53 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.517s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:53 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:53 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:53 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:53 devstack sudo[73637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 16 19:41:53 devstack sudo[73637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:54 devstack sudo[73637]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:54 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.504s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:54 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:54 devstack sudo[73641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 19:41:54 devstack sudo[73641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:54 devstack sudo[73641]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:54 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:54 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:54 devstack sudo[73646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 19:41:54 devstack sudo[73646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:55 devstack sudo[73646]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:55 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.512s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:55 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:55 devstack sudo[73651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 19:41:55 devstack sudo[73651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:55 devstack sudo[73651]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:55 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:55 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:55 devstack sudo[73654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 19:41:55 devstack sudo[73654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:56 devstack sudo[73654]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:56 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.482s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:56 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:56 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:56 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:56 devstack sudo[73664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 19:41:56 devstack sudo[73664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:56 devstack sudo[73664]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:56 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.669s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:56 devstack cinder-volume[72941]: INFO cinder.volume.drivers.lvm [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 16 19:41:56 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:56 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:56 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:56 devstack sudo[73780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 19:41:56 devstack sudo[73780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:57 devstack sudo[73780]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:57 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.541s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:57 devstack cinder-volume[72941]: DEBUG cinder.volume.drivers.lvm [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Updating volume stats {{(pid=72941) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 16 19:41:57 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:57 devstack sudo[73888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 19:41:57 devstack sudo[73888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:58 devstack sudo[73888]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:58 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.575s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:58 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:58 devstack sudo[73922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 19:41:58 devstack sudo[73922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:58 devstack sudo[73922]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:58 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.519s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:58 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:58 devstack sudo[73928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 19:41:58 devstack sudo[73928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:59 devstack sudo[73928]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:59 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.528s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:59 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:59 devstack sudo[73932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 19:41:59 devstack sudo[73932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:41:59 devstack sudo[73932]: pam_unix(sudo:session): session closed for user root
Apr 16 19:41:59 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:41:59 devstack cinder-volume[72941]: INFO cinder.volume.driver [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Driver hasn't implemented _init_vendor_properties()
Apr 16 19:41:59 devstack cinder-volume[72941]: DEBUG cinder.volume.driver [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72941) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 16 19:41:59 devstack cinder-volume[72941]: DEBUG oslo_db.sqlalchemy.engines [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72941) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 19:41:59 devstack cinder-volume[72941]: DEBUG dbcounter [-] [72941] Writer thread running {{(pid=72941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 16 19:41:59 devstack cinder-volume[72941]: DEBUG cinder.db.sqlalchemy.api [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Building query based on filter {{(pid=72941) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 16 19:41:59 devstack cinder-volume[72941]: DEBUG cinder.image.image_utils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72941) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 16 19:41:59 devstack cinder-volume[72941]: INFO cinder.keymgr.migration [None req-b51515a3-377d-490f-be85-ba1cf633d718 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 16 19:41:59 devstack cinder-volume[72941]: DEBUG cinder.volume.drivers.lvm [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Updating volume stats {{(pid=72941) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 16 19:41:59 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:41:59 devstack sudo[73970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 19:41:59 devstack sudo[73970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:42:00 devstack cinder-volume[72830]: DEBUG dbcounter [-] [72830] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72830) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:42:00 devstack sudo[73970]: pam_unix(sudo:session): session closed for user root
Apr 16 19:42:00 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:42:00 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:42:00 devstack sudo[73978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 19:42:00 devstack sudo[73978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:42:00 devstack sudo[73978]: pam_unix(sudo:session): session closed for user root
Apr 16 19:42:00 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:42:00 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:42:00 devstack sudo[73982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 19:42:00 devstack sudo[73982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:42:01 devstack sudo[73982]: pam_unix(sudo:session): session closed for user root
Apr 16 19:42:01 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:42:01 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:42:01 devstack sudo[73986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 19:42:01 devstack sudo[73986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:42:02 devstack sudo[73986]: pam_unix(sudo:session): session closed for user root
Apr 16 19:42:02 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.513s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:42:02 devstack cinder-volume[72941]: DEBUG cinder.manager [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Notifying Schedulers of capabilities ... {{(pid=72941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:42:02 devstack cinder-volume[72941]: INFO cinder.volume.manager [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Driver initialization completed successfully.
Apr 16 19:42:02 devstack cinder-volume[72941]: INFO cinder.manager [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Initiating service 2 cleanup
Apr 16 19:42:02 devstack cinder-volume[72941]: INFO cinder.manager [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Service 2 cleanup completed.
Apr 16 19:42:02 devstack cinder-volume[72941]: DEBUG cinder.service [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Creating RPC server for service cinder-volume {{(pid=72941) start /opt/stack/cinder/cinder/service.py:231}}
Apr 16 19:42:02 devstack cinder-volume[72941]: DEBUG cinder.service [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72941) start /opt/stack/cinder/cinder/service.py:237}}
Apr 16 19:42:02 devstack cinder-volume[72941]: INFO cinder.volume.manager [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 16 19:42:02 devstack cinder-volume[72941]: DEBUG cinder.volume.drivers.lvm [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Updating volume stats {{(pid=72941) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 16 19:42:02 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:42:02 devstack sudo[73989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 19:42:02 devstack sudo[73989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:42:02 devstack sudo[73989]: pam_unix(sudo:session): session closed for user root
Apr 16 19:42:02 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:42:02 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:42:02 devstack sudo[74049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 19:42:02 devstack sudo[74049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:42:03 devstack sudo[74049]: pam_unix(sudo:session): session closed for user root
Apr 16 19:42:03 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:42:03 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:42:03 devstack sudo[74052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 19:42:03 devstack sudo[74052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:42:03 devstack sudo[74052]: pam_unix(sudo:session): session closed for user root
Apr 16 19:42:03 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.478s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:42:03 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:42:03 devstack sudo[74056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 19:42:03 devstack sudo[74056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:42:04 devstack sudo[74056]: pam_unix(sudo:session): session closed for user root
Apr 16 19:42:04 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.539s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:42:04 devstack cinder-volume[72941]: INFO cinder.volume.manager [None req-e4cb49bf-997c-433c-b785-8e625d58077a None None] Driver post RPC initialization completed successfully.
Apr 16 19:42:09 devstack cinder-volume[72941]: DEBUG dbcounter [-] [72941] Writing DB stats cinder:SELECT=2 {{(pid=72941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:42:14 devstack cinder-volume[72941]: DEBUG dbcounter [-] [72941] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:43:17 devstack cinder-volume[72941]: DEBUG oslo_service.periodic_task [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 19:43:17 devstack cinder-volume[72941]: DEBUG cinder.volume.drivers.lvm [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Updating volume stats {{(pid=72941) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 16 19:43:17 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:43:17 devstack sudo[78796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 19:43:17 devstack sudo[78796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:43:17 devstack sudo[78796]: pam_unix(sudo:session): session closed for user root
Apr 16 19:43:17 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:43:17 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:43:17 devstack sudo[78800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 19:43:17 devstack sudo[78800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:43:18 devstack sudo[78800]: pam_unix(sudo:session): session closed for user root
Apr 16 19:43:18 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:43:18 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:43:18 devstack sudo[78803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 19:43:18 devstack sudo[78803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:43:18 devstack sudo[78803]: pam_unix(sudo:session): session closed for user root
Apr 16 19:43:18 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.558s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:43:18 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:43:18 devstack sudo[78807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 19:43:18 devstack sudo[78807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:43:19 devstack sudo[78807]: pam_unix(sudo:session): session closed for user root
Apr 16 19:43:19 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.522s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:43:19 devstack cinder-volume[72941]: DEBUG cinder.manager [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Notifying Schedulers of capabilities ... {{(pid=72941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:44:14 devstack cinder-volume[72941]: DEBUG dbcounter [-] [72941] Writing DB stats cinder:SELECT=1 {{(pid=72941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:44:14 devstack cinder-volume[72941]: DEBUG dbcounter [-] [72941] Writing DB stats cinder:UPDATE=1 {{(pid=72941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:44:17 devstack cinder-volume[72941]: DEBUG oslo_service.periodic_task [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 19:44:17 devstack cinder-volume[72941]: DEBUG cinder.volume.drivers.lvm [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Updating volume stats {{(pid=72941) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 16 19:44:17 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:44:17 devstack sudo[79837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 19:44:17 devstack sudo[79837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:44:17 devstack sudo[79837]: pam_unix(sudo:session): session closed for user root
Apr 16 19:44:17 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.538s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:44:17 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:44:17 devstack sudo[79840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 19:44:17 devstack sudo[79840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:44:18 devstack sudo[79840]: pam_unix(sudo:session): session closed for user root
Apr 16 19:44:18 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:44:18 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:44:18 devstack sudo[79853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 19:44:18 devstack sudo[79853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:44:18 devstack sudo[79853]: pam_unix(sudo:session): session closed for user root
Apr 16 19:44:18 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.522s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:44:18 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:44:18 devstack sudo[79873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 19:44:18 devstack sudo[79873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:44:19 devstack sudo[79873]: pam_unix(sudo:session): session closed for user root
Apr 16 19:44:19 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.546s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:44:19 devstack cinder-volume[72941]: DEBUG cinder.manager [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Notifying Schedulers of capabilities ... {{(pid=72941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:45:17 devstack cinder-volume[72941]: DEBUG oslo_service.periodic_task [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 19:45:17 devstack cinder-volume[72941]: DEBUG cinder.volume.drivers.lvm [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Updating volume stats {{(pid=72941) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 16 19:45:17 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:45:17 devstack sudo[81368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 19:45:17 devstack sudo[81368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:45:17 devstack sudo[81368]: pam_unix(sudo:session): session closed for user root
Apr 16 19:45:17 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:45:17 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:45:17 devstack sudo[81413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 19:45:17 devstack sudo[81413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:45:18 devstack sudo[81413]: pam_unix(sudo:session): session closed for user root
Apr 16 19:45:18 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:45:18 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:45:18 devstack sudo[81439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 19:45:18 devstack sudo[81439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:45:18 devstack sudo[81439]: pam_unix(sudo:session): session closed for user root
Apr 16 19:45:18 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.608s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:45:18 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:45:18 devstack sudo[81449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 19:45:18 devstack sudo[81449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:45:19 devstack sudo[81449]: pam_unix(sudo:session): session closed for user root
Apr 16 19:45:19 devstack cinder-volume[72941]: DEBUG oslo_concurrency.processutils [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=72941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:45:19 devstack cinder-volume[72941]: DEBUG cinder.manager [None req-105fe71f-fd75-4bad-b238-a051fcb5b20f None None] Notifying Schedulers of capabilities ... {{(pid=72941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:45:48 devstack cinder-volume[72830]: INFO oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Caught SIGTERM, stopping children
Apr 16 19:45:48 devstack cinder-volume[72830]: DEBUG oslo_concurrency.lockutils [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Acquiring lock "singleton_lock" {{(pid=72830) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 19:45:48 devstack cinder-volume[72830]: DEBUG oslo_concurrency.lockutils [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Acquired lock "singleton_lock" {{(pid=72830) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 19:45:48 devstack cinder-volume[72830]: DEBUG oslo_concurrency.lockutils [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Releasing lock "singleton_lock" {{(pid=72830) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 19:45:48 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Stop services. {{(pid=72830) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 16 19:45:48 devstack cinder-volume[72830]: DEBUG oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Killing children. {{(pid=72830) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 16 19:45:48 devstack cinder-volume[72830]: INFO oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Waiting on 1 children to exit
Apr 16 19:45:52 devstack cinder-volume[72941]: DEBUG oslo_concurrency.lockutils [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Acquiring lock "singleton_lock" {{(pid=72941) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 19:45:52 devstack cinder-volume[72941]: DEBUG oslo_concurrency.lockutils [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Acquired lock "singleton_lock" {{(pid=72941) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 19:45:52 devstack cinder-volume[72941]: DEBUG oslo_concurrency.lockutils [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Releasing lock "singleton_lock" {{(pid=72941) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 19:45:52 devstack cinder-volume[72941]: WARNING amqp [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 16 19:45:52 devstack cinder-volume[72941]: WARNING amqp [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 16 19:45:52 devstack cinder-volume[72830]: INFO oslo_service.backend._eventlet.service [None req-da4ef5fb-5e78-4e8d-b756-fafd89d880a5 None None] Child 72941 exited with status 0
Apr 16 19:45:52 devstack cinder-volume[82050]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 16 19:45:52 devstack cinder-volume[82050]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 16 19:45:52 devstack cinder-volume[82050]: we strongly recommend against using it for new projects.
Apr 16 19:45:52 devstack cinder-volume[82050]: If you are already using Eventlet, we recommend migrating to a different
Apr 16 19:45:52 devstack cinder-volume[82050]: framework.  For more detail see
Apr 16 19:45:52 devstack cinder-volume[82050]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 16 19:45:52 devstack cinder-volume[82050]:   import eventlet  # noqa
Apr 16 19:45:54 devstack cinder-volume[82050]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82050) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 19:45:54 devstack cinder-volume[82050]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82050) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 19:45:54 devstack cinder-volume[82050]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82050) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 19:45:55 devstack cinder-volume[82050]: INFO dbcounter [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Registered counter for database cinder
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82050) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG dbcounter [-] [82050] Writer thread running {{(pid=82050) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 16 19:45:55 devstack cinder-volume[82050]: INFO cinder.rpc [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 16 19:45:55 devstack cinder-volume[82050]: INFO cinder.rpc [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82050) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 19:45:55 devstack cinder-volume[82050]: INFO cinder.volume.manager [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Determined volume DB was empty at startup.
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG cinder.volume.manager [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82050) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 16 19:45:55 devstack cinder-volume[82050]: INFO cinder.volume.manager [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 16 19:45:55 devstack cinder-volume[82050]: WARNING stevedore.named [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 16 19:45:55 devstack cinder-volume[82050]: WARNING castellan.key_manager [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 19:45:55 devstack cinder-volume[82050]: WARNING cinder.keymgr.conf_key_mgr [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 19:45:55 devstack cinder-volume[82050]: INFO cinder.volume.manager [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82050) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 19:45:55 devstack cinder-volume[82050]: INFO oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Starting 1 workers
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Started child 82168 {{(pid=82050) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Full set of CONF: {{(pid=82050) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] ******************************************************************************** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Configuration options gathered from: {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] ================================================================================ {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 16 19:45:55 devstack cinder-volume[82168]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] allow_availability_zone_fallback = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] allow_compression_on_image_upload = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] allowed_direct_url_schemes     = [] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] api_rate_limit                 = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] auth_strategy                  = keystone {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_availability_zone      = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_host                   = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_name                   = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_stats_polling_interval = 60 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backup_api_class               = cinder.backup.api.API {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backup_name_template           = backup-%s {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backup_use_same_host           = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backup_use_temp_snapshot       = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] chap_password                  = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] chap_username                  =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cinder_internal_tenant_project_id = 80e217e0d8334912a6fcd1a3f120d09b {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cinder_internal_tenant_user_id = da401ea1aef64647904fba7dae53f5a1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cluster                        = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] compression_format             = gzip {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] config_dir                     = [] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] config_source                  = [] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] control_exchange               = openstack {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] debug                          = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] default_availability_zone      = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] default_group_type             = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] default_volume_type            = QuobyteHD {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] disk_geometry                  = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] driver_client_cert             = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] driver_client_cert_key         = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] driver_data_namespace          = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] driver_ssl_cert_path           = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] driver_ssl_cert_verify         = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] driver_use_ssl                 = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] enable_new_services            = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] enable_unsupported_driver      = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] enforce_multipath_for_image_xfer = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] filter_function                = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance_api_insecure            = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance_api_servers             = ['http://192.168.122.140/image'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance_api_ssl_compression     = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance_ca_certificates_file    = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance_certfile                = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance_keyfile                 = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance_num_retries             = 3 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance_request_timeout         = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] goodness_function              = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] graceful_shutdown_timeout      = 5 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] group_api_class                = cinder.group.api.API {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] host                           = devstack {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] image_compress_on_upload       = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] image_conversion_address_space_limit = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] image_conversion_cpu_limit     = 60 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] image_conversion_disable       = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] image_upload_use_cinder_backend = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] image_upload_use_internal_tenant = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] image_volume_cache_enabled     = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] image_volume_cache_max_count   = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] image_volume_cache_max_size_gb = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] init_host_max_objects_retrieval = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] iscsi_target_flags             =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] iscsi_write_cache              = on {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] iser_helper                    = tgtadm {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] iser_ip_address                = 192.168.122.140 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] iser_port                      = 3260 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] log_color                      = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] log_config_append              = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] log_dir                        = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] log_file                       = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] log_options                    = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] log_rotate_interval            = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] log_rotate_interval_type       = days {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] log_rotation_type              = none {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82168]: INFO cinder.volume.manager [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82168]: DEBUG cinder.volume.drivers.remotefs [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82168) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] max_age                        = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] max_logfile_count              = 30 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] max_logfile_size_mb            = 200 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] max_over_subscription_ratio    = 20.0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] message_reap_interval          = 86400 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] message_ttl                    = 2592000 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] migration_create_volume_timeout_secs = 300 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] monkey_patch                   = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] monkey_patch_modules           = [] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] my_ip                          = 192.168.122.140 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] no_snapshot_gb_quota           = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] num_iser_scan_tries            = 3 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] num_shell_tries                = 3 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] num_volume_device_scan_tries   = 3 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] nvmeof_conn_info_version       = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] nvmet_ns_id                    = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] nvmet_port_id                  = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] osapi_max_limit                = 1000 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] osapi_volume_ext_list          = [] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] osapi_volume_listen_port       = 8776 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] osapi_volume_use_ssl           = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] osapi_volume_workers           = 2 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] per_volume_size_limit          = -1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] periodic_fuzzy_delay           = 60 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] periodic_interval              = 60 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] public_endpoint                = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] publish_errors                 = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] quota_backup_gigabytes         = 1000 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] quota_backups                  = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] quota_gigabytes                = 1000 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] quota_groups                   = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] quota_snapshots                = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] quota_volumes                  = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] rate_limit_burst               = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] rate_limit_except_level        = CRITICAL {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] rate_limit_interval            = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] reinit_driver_count            = 3 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] replication_device             = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] report_discard_supported       = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] report_interval                = 120 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] reservation_clean_interval     = 86400 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] reservation_expire             = 86400 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] reserved_image_namespaces      = [] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] reserved_percentage            = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] rpc_response_timeout           = 120 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] run_external_periodic_tasks    = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] scst_target_driver             = iscsi {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] scst_target_iqn_name           = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] service_down_time              = 720 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] shell_completion               = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] snapshot_name_template         = snapshot-%s {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] split_loggers                  = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] state_path                     = /opt/stack/data/cinder {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] storage_availability_zone      = nova {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] storage_protocol               = iSCSI {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] syslog_log_facility            = LOG_USER {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] target_helper                  = lioadm {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] target_ip_address              = 192.168.122.140 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] target_port                    = 3260 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] target_protocol                = iscsi {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] target_secondary_ip_addresses  = [] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] trace_flags                    = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] transport_url                  = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] until_refresh                  = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] use_chap_auth                  = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] use_default_quota_class        = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] use_journal                    = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] use_json                       = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] use_multipath_for_image_xfer   = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] use_stderr                     = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] use_syslog                     = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] verify_glance_signatures       = enabled {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] volume_api_class               = cinder.volume.api.API {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] volume_backend_name            = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] volume_clear                   = zero {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] volume_clear_ionice            = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] volume_clear_size              = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] volume_copy_bps_limit          = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] volume_dd_blocksize            = 1M {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] volume_name_template           = volume-%s {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] volume_service_inithost_offload = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] volume_usage_audit_period      = month {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] zoning_mode                    = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_concurrency.disable_process_locking = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.admin_password = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.admin_token = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.admin_user  = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.auth_protocol = https {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.auth_section = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.auth_type   = password {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.auth_uri    = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.auth_version = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.cache       = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.certfile    = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.identity_uri = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.include_service_catalog = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.insecure    = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.interface   = public {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.keyfile     = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_password =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcache_username =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.region_name = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.service_type = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.backend                  = dogpile.cache.null {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.backend_argument         = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.backend_expiration_time  = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.config_prefix            = cache.oslo {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.debug_cache_backend      = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.enable_retry_client      = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.enable_socket_keepalive  = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.enabled                  = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.enforce_fips_mode        = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.expiration_time          = 600 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.hashclient_retry_attempts = 2 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.memcache_dead_retry      = 300 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.memcache_sasl_enabled    = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.password                 = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.proxies                  = [] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.redis_db                 = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.redis_server             = localhost:6379 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.retry_attempts           = 2 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.retry_delay              = 0.0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.socket_keepalive_count   = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.socket_keepalive_idle    = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.socket_keepalive_interval = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.socket_timeout           = 1.0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.tls_allowed_ciphers      = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.tls_cafile               = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.tls_certfile             = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.tls_enabled              = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.tls_keyfile              = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cache.username                 = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] coordination.backend_url       = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.asyncio_connection    = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82168]: DEBUG cinder.volume.drivers.quobyte [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82168) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.asyncio_slave_connection = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.backend               = sqlalchemy {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.connection            = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82168]: WARNING cinder.volume.drivers.quobyte [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.connection_debug      = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82168]: WARNING cinder.volume.drivers.quobyte [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.connection_parameters =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.connection_recycle_time = 3600 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.connection_trace      = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.db_inc_retry_interval = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.db_max_retries        = 20 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.db_max_retry_interval = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.db_retry_interval     = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82168]: DEBUG oslo_concurrency.processutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Running cmd (subprocess): mount.quobyte {{(pid=82168) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.max_overflow          = 50 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.max_pool_size         = 5 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.max_retries           = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.mysql_wsrep_sync_wait = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.pool_timeout          = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.retry_interval        = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.slave_connection      = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.sqlite_synchronous    = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.synchronous_reader    = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] database.use_db_reconnect      = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler.connection_string     = messaging:// {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler.enabled               = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler.es_doc_type           = notification {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler.es_scroll_size        = 10000 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler.es_scroll_time        = 2m {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler.filter_error_trace    = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler.hmac_keys             = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler.sentinel_service_name = mymaster {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler.socket_timeout        = 0.1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler.trace_requests        = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler.trace_sqlalchemy      = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler_jaeger.process_tags   = {} {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler_jaeger.service_name_prefix = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] profiler_otlp.service_name_prefix = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_policy.enforce_new_defaults = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: WARNING oslo_config.cfg [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_policy.enforce_scope      = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_policy.policy_default_rule = default {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] privsep_osbrick.group          = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] privsep_osbrick.helper_command = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] privsep_osbrick.user           = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cinder_sys_admin.group         = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cinder_sys_admin.helper_command = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] cinder_sys_admin.user          = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] service_user.auth_section      = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] service_user.auth_type         = password {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] service_user.cafile            = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] service_user.certfile          = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] service_user.collect_timing    = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] service_user.insecure          = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] service_user.keyfile           = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] service_user.send_service_user_token = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] service_user.split_loggers     = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] service_user.timeout           = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance.auth_section            = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance.auth_type               = password {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance.certfile                = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance.collect_timing          = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance.insecure                = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance.keyfile                 = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance.region_name             = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance.split_loggers           = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] glance.timeout                 = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.backend_availability_zone = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.chap_password = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.chap_username =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.disk_geometry = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.driver_client_cert = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.driver_client_cert_key = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.driver_data_namespace = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.driver_use_ssl = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.extra_capabilities = {} {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.filter_function = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.goodness_function = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.iscsi_target_flags =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.iscsi_write_cache = on {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.iser_port     = 3260 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.nas_host      =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.nas_login     = admin {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.nas_mount_options = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.nas_password  = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.nas_private_key =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.nas_share_path =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.num_shell_tries = 3 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.quobyte_volume_url = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.replication_device = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.report_discard_supported = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.reserved_percentage = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.target_helper = tgtadm {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.target_port   = 3260 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.target_protocol = iscsi {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.trace_flags   = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.unique_fqdn_network = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.use_chap_auth = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.volume_backend_name = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.volume_clear  = zero {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.volume_clear_ionice = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.volume_clear_size = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_reports.file_event_handler = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_reports.log_dir           = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.backend_availability_zone = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.backend_host         = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.chap_password        = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.chap_username        = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.disk_geometry        = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.driver_client_cert   = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.driver_data_namespace = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.extra_capabilities   = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.filter_function      = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.goodness_function    = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.iser_helper          = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.iser_ip_address      = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.iser_port            = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.nas_host             = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.nas_login            = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.nas_mount_options    = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.nas_password         = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.nas_private_key      = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.nas_share_path       = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.num_shell_tries      = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.replication_device   = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.report_discard_supported = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.reserved_percentage  = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.scst_target_driver   = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.storage_protocol     = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.target_helper        = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.target_ip_address    = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.target_port          = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.target_prefix        = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.target_protocol      = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.trace_flags          = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.use_chap_auth        = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.volume_clear         = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.volume_clear_size    = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] QuobyteHD.volumes_dir          = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack quobyte-client[82169]: Reading configuration file: /etc/quobyte/client.cfg
Apr 16 19:45:55 devstack quobyte-client[82169]: Invalid parameters found, error: missing mount point.
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack quobyte-client[82169]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack quobyte-client[82169]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_notifications.driver = [] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_notifications.retry = -1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] key_manager.fixed_key          = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.barbican_api_version  = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.barbican_endpoint     = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.barbican_endpoint_type = public {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.barbican_region_name  = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.cafile                = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.certfile              = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.collect_timing        = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.insecure              = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.keyfile               = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.number_of_retries     = 60 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.retry_delay           = 1 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.send_service_user_token = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.split_loggers         = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.timeout               = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.verify_ssl            = True {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican.verify_ssl_path       = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82168]: DEBUG oslo_concurrency.processutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=82168) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican_service_user.auth_section = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican_service_user.auth_type = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82168) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican_service_user.cafile   = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82168) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican_service_user.certfile = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82168]: DEBUG cinder.volume.drivers.quobyte [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82168) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican_service_user.collect_timing = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican_service_user.insecure = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican_service_user.keyfile  = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82168]: INFO cinder.volume.drivers.quobyte [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de ...
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican_service_user.split_loggers = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] barbican_service_user.timeout  = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82168]: DEBUG oslo_concurrency.processutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 -c /etc/quobyte/client-cinder.cfg {{(pid=82168) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] vault.approle_role_id          = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] vault.approle_secret_id        = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] vault.kv_mountpoint            = secret {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] vault.kv_path                  = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] vault.kv_version               = 2 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] vault.namespace                = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] vault.root_token_id            = **** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] vault.ssl_ca_crt_file          = None {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] vault.timeout                  = 60.0 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] vault.use_ssl                  = False {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:45:55 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] ******************************************************************************** {{(pid=82050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 16 19:45:55 devstack sudo[82170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 -c /etc/quobyte/client-cinder.cfg
Apr 16 19:45:55 devstack sudo[82170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:45:56 devstack sudo[82170]: pam_unix(sudo:session): session closed for user root
Apr 16 19:45:56 devstack cinder-volume[82168]: DEBUG oslo_concurrency.processutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.605s {{(pid=82168) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:45:56 devstack cinder-volume[82168]: INFO cinder.volume.drivers.quobyte [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de succeeded
Apr 16 19:45:56 devstack cinder-volume[82168]: DEBUG cinder.volume.drivers.quobyte [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82168) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:45:56 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.611s {{(pid=82168) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:45:56 devstack cinder-volume[82168]: DEBUG oslo_concurrency.processutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82168) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:45:56 devstack sudo[82240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:45:56 devstack sudo[82240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:45:57 devstack sudo[82240]: pam_unix(sudo:session): session closed for user root
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG oslo_concurrency.processutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.446s {{(pid=82168) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:45:57 devstack cinder-volume[82168]: INFO cinder.volume.driver [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Driver hasn't implemented _init_vendor_properties()
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG cinder.volume.driver [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5436706542969, 'free_capacity_gb': 1775.5436706542969, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82168) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG oslo_db.sqlalchemy.engines [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82168) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG dbcounter [-] [82168] Writer thread running {{(pid=82168) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG cinder.db.sqlalchemy.api [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Building query based on filter {{(pid=82168) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG cinder.image.image_utils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82168) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 16 19:45:57 devstack cinder-volume[82168]: INFO cinder.keymgr.migration [None req-fbbaf6d9-aa86-42bf-a2ab-ec16bf84cd6b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82168) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82168) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG cinder.volume.drivers.quobyte [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82168) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG cinder.volume.drivers.quobyte [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82168) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82168) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG oslo_concurrency.processutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82168) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:45:57 devstack sudo[82244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:45:57 devstack sudo[82244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:45:57 devstack sudo[82244]: pam_unix(sudo:session): session closed for user root
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG oslo_concurrency.processutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.423s {{(pid=82168) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG cinder.manager [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Notifying Schedulers of capabilities ... {{(pid=82168) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:45:57 devstack cinder-volume[82168]: INFO cinder.volume.manager [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Driver initialization completed successfully.
Apr 16 19:45:57 devstack cinder-volume[82168]: INFO cinder.manager [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Initiating service 3 cleanup
Apr 16 19:45:57 devstack cinder-volume[82168]: INFO cinder.manager [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Service 3 cleanup completed.
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG cinder.service [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Creating RPC server for service cinder-volume {{(pid=82168) start /opt/stack/cinder/cinder/service.py:231}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG cinder.service [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82168) start /opt/stack/cinder/cinder/service.py:237}}
Apr 16 19:45:57 devstack cinder-volume[82168]: INFO cinder.volume.manager [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82168) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82168) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG cinder.volume.drivers.quobyte [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82168) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG cinder.volume.drivers.quobyte [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82168) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82168) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:45:57 devstack cinder-volume[82168]: DEBUG oslo_concurrency.processutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82168) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:45:57 devstack sudo[82250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:45:57 devstack sudo[82250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:45:58 devstack sudo[82250]: pam_unix(sudo:session): session closed for user root
Apr 16 19:45:58 devstack cinder-volume[82168]: DEBUG oslo_concurrency.processutils [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.481s {{(pid=82168) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:45:58 devstack cinder-volume[82168]: INFO cinder.volume.manager [None req-1c02a8ef-52b9-40f4-bbe5-09ea824723ad None None] Driver post RPC initialization completed successfully.
Apr 16 19:46:01 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-1616e9c7-a27f-4cac-a61c-a977b61cd2ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82168) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:46:01 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-1616e9c7-a27f-4cac-a61c-a977b61cd2ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82168) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:46:01 devstack cinder-volume[82168]: DEBUG cinder.volume.drivers.quobyte [None req-1616e9c7-a27f-4cac-a61c-a977b61cd2ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82168) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:46:01 devstack cinder-volume[82168]: DEBUG cinder.volume.drivers.quobyte [None req-1616e9c7-a27f-4cac-a61c-a977b61cd2ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82168) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:46:01 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-1616e9c7-a27f-4cac-a61c-a977b61cd2ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82168) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:46:01 devstack cinder-volume[82168]: DEBUG oslo_concurrency.processutils [None req-1616e9c7-a27f-4cac-a61c-a977b61cd2ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82168) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:46:01 devstack sudo[82376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:46:01 devstack sudo[82376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:46:01 devstack cinder-volume[82050]: INFO oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Caught SIGTERM, stopping children
Apr 16 19:46:01 devstack cinder-volume[82050]: DEBUG oslo_concurrency.lockutils [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Acquiring lock "singleton_lock" {{(pid=82050) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 19:46:01 devstack cinder-volume[82050]: DEBUG oslo_concurrency.lockutils [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Acquired lock "singleton_lock" {{(pid=82050) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 19:46:01 devstack cinder-volume[82050]: DEBUG oslo_concurrency.lockutils [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Releasing lock "singleton_lock" {{(pid=82050) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 19:46:01 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Stop services. {{(pid=82050) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 16 19:46:01 devstack cinder-volume[82050]: DEBUG oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Killing children. {{(pid=82050) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 16 19:46:01 devstack cinder-volume[82050]: INFO oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Waiting on 1 children to exit
Apr 16 19:46:02 devstack sudo[82376]: pam_unix(sudo:session): session closed for user root
Apr 16 19:46:02 devstack cinder-volume[82168]: DEBUG oslo_concurrency.processutils [None req-1616e9c7-a27f-4cac-a61c-a977b61cd2ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.535s {{(pid=82168) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:46:02 devstack cinder-volume[82168]: DEBUG cinder.manager [None req-1616e9c7-a27f-4cac-a61c-a977b61cd2ac None None] Notifying Schedulers of capabilities ... {{(pid=82168) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1616e9c7-a27f-4cac-a61c-a977b61cd2ac None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1616e9c7-a27f-4cac-a61c-a977b61cd2ac None None] Unable to connect to AMQP server on 192.168.122.140:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server [None req-1616e9c7-a27f-4cac-a61c-a977b61cd2ac None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.140:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1140, in ensure
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     ret, channel = autoretry_method()
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 558, in _ensured
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     return fun(*args, **kwargs)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 641, in __call__
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     return fun(*args, channel=channels[0], **kwargs), channels[0]
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1129, in execute_method
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     method()
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1591, in _publish
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     self._producer.publish(
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 190, in publish
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     return _publish(
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 214, in _publish
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     return channel.basic_publish(
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     self.connection.drain_events(timeout=timeout)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     while not self.blocking_read(timeout):
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     return self.on_inbound_frame(frame)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     callback(channel, method_sig, buf, None)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     return self.channels[channel_id].dispatch_method(
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     listener(*args)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 293, in _on_close
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     raise error_for_code(
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server 
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server 
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     self._publish_service_capabilities(context)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     self.scheduler_rpcapi.update_service_capabilities(
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 154, in cast
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     self.transport._send(self.target, msg_ctxt, msg,
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     conn.fanout_send(target.topic, msg, retry=retry)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1710, in fanout_send
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1540, in _ensure_publishing
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     self.ensure(method, retry=retry, error_callback=_error_callback)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in ensure
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server     raise exceptions.MessageDeliveryFailure(msg)
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.140:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 16 19:46:02 devstack cinder-volume[82168]: ERROR oslo_messaging.rpc.server 
Apr 16 19:46:05 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Acquiring lock "singleton_lock" {{(pid=82168) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 19:46:05 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Acquired lock "singleton_lock" {{(pid=82168) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 19:46:05 devstack cinder-volume[82168]: DEBUG oslo_concurrency.lockutils [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Releasing lock "singleton_lock" {{(pid=82168) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 19:46:05 devstack cinder-volume[82168]: WARNING amqp [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 16 19:46:05 devstack cinder-volume[82168]: WARNING amqp [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 16 19:46:05 devstack cinder-volume[82050]: INFO oslo_service.backend._eventlet.service [None req-f3e9aee9-e9cf-48ce-8278-e199cfe89788 None None] Child 82168 exited with status 0
Apr 16 19:46:06 devstack cinder-volume[82441]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 16 19:46:06 devstack cinder-volume[82441]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 16 19:46:06 devstack cinder-volume[82441]: we strongly recommend against using it for new projects.
Apr 16 19:46:06 devstack cinder-volume[82441]: If you are already using Eventlet, we recommend migrating to a different
Apr 16 19:46:06 devstack cinder-volume[82441]: framework.  For more detail see
Apr 16 19:46:06 devstack cinder-volume[82441]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 16 19:46:06 devstack cinder-volume[82441]:   import eventlet  # noqa
Apr 16 19:46:07 devstack cinder-volume[82441]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 19:46:07 devstack cinder-volume[82441]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 19:46:07 devstack cinder-volume[82441]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 19:46:08 devstack cinder-volume[82441]: INFO dbcounter [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] Registered counter for database cinder
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_db.sqlalchemy.engines [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG dbcounter [-] [82441] Writer thread running {{(pid=82441) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 16 19:46:08 devstack cinder-volume[82441]: INFO cinder.rpc [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 16 19:46:08 devstack cinder-volume[82441]: INFO cinder.rpc [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_db.sqlalchemy.engines [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 19:46:08 devstack cinder-volume[82441]: INFO cinder.volume.manager [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] Determined volume DB was empty at startup.
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG cinder.volume.manager [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82441) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 16 19:46:08 devstack cinder-volume[82441]: WARNING stevedore.named [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 16 19:46:08 devstack cinder-volume[82441]: WARNING castellan.key_manager [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 19:46:08 devstack cinder-volume[82441]: WARNING cinder.keymgr.conf_key_mgr [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 19:46:08 devstack cinder-volume[82441]: INFO cinder.volume.manager [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_db.sqlalchemy.engines [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 19:46:08 devstack cinder-volume[82441]: INFO oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] Starting 1 workers
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] Started child 82616 {{(pid=82441) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] Full set of CONF: {{(pid=82441) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] ******************************************************************************** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] Configuration options gathered from: {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] ================================================================================ {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] allow_availability_zone_fallback = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] allow_compression_on_image_upload = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] allowed_direct_url_schemes     = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] api_rate_limit                 = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] auth_strategy                  = keystone {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_availability_zone      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_host                   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_name                   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_stats_polling_interval = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backup_api_class               = cinder.backup.api.API {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backup_name_template           = backup-%s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backup_use_same_host           = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backup_use_temp_snapshot       = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] chap_password                  = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] chap_username                  =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cinder_internal_tenant_project_id = 80e217e0d8334912a6fcd1a3f120d09b {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82616]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cinder_internal_tenant_user_id = da401ea1aef64647904fba7dae53f5a1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cluster                        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] compression_format             = gzip {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] compute_api_class              = cinder.compute.nova.API {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] config_dir                     = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] config_source                  = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] control_exchange               = openstack {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] debug                          = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] default_availability_zone      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] default_group_type             = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] default_volume_type            = QuobyteHD {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] disk_geometry                  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] driver_client_cert             = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] driver_client_cert_key         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] driver_data_namespace          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] driver_ssl_cert_path           = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] driver_ssl_cert_verify         = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] driver_use_ssl                 = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] enable_new_services            = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] enable_unsupported_driver      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] enabled_backends               = ['QuobyteHD'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] enforce_multipath_for_image_xfer = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] filter_function                = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance_api_insecure            = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance_api_servers             = ['http://192.168.122.140/image'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance_api_ssl_compression     = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance_ca_certificates_file    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance_catalog_info            = image:glance:publicURL {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance_certfile                = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance_keyfile                 = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance_num_retries             = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance_request_timeout         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] goodness_function              = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] graceful_shutdown_timeout      = 5 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] group_api_class                = cinder.group.api.API {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] host                           = devstack {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] image_compress_on_upload       = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] image_conversion_address_space_limit = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] image_conversion_cpu_limit     = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] image_conversion_disable       = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] image_upload_use_cinder_backend = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] image_upload_use_internal_tenant = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] image_volume_cache_enabled     = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] image_volume_cache_max_count   = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] image_volume_cache_max_size_gb = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] init_host_max_objects_retrieval = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] instance_format                = [instance: %(uuid)s]  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] iscsi_target_flags             =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] iscsi_write_cache              = on {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] iser_helper                    = tgtadm {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] iser_ip_address                = 192.168.122.140 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] iser_port                      = 3260 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] log_color                      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] log_config_append              = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] log_dir                        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] log_file                       = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] log_options                    = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] log_rotate_interval            = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] log_rotate_interval_type       = days {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] log_rotation_type              = none {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] max_age                        = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] max_logfile_count              = 30 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] max_logfile_size_mb            = 200 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] max_over_subscription_ratio    = 20.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] message_reap_interval          = 86400 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] message_ttl                    = 2592000 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] migration_create_volume_timeout_secs = 300 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] monkey_patch                   = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] monkey_patch_modules           = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] my_ip                          = 192.168.122.140 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] no_snapshot_gb_quota           = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] num_iser_scan_tries            = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] num_shell_tries                = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] num_volume_device_scan_tries   = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] nvmeof_conn_info_version       = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] nvmet_ns_id                    = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] nvmet_port_id                  = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] osapi_max_limit                = 1000 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] osapi_volume_ext_list          = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] osapi_volume_listen_port       = 8776 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] osapi_volume_use_ssl           = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] osapi_volume_workers           = 2 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] per_volume_size_limit          = -1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] periodic_fuzzy_delay           = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] periodic_interval              = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] public_endpoint                = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] publish_errors                 = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] quota_backup_gigabytes         = 1000 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] quota_backups                  = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] quota_gigabytes                = 1000 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] quota_groups                   = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] quota_snapshots                = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] quota_volumes                  = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] rate_limit_burst               = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] rate_limit_except_level        = CRITICAL {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] rate_limit_interval            = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] reinit_driver_count            = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] replication_device             = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] report_discard_supported       = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] report_interval                = 120 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] reservation_clean_interval     = 86400 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] reservation_expire             = 86400 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] reserved_image_namespaces      = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] reserved_percentage            = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] rpc_response_timeout           = 120 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] run_external_periodic_tasks    = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] scst_target_driver             = iscsi {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] scst_target_iqn_name           = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] service_down_time              = 720 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] shell_completion               = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] snapshot_name_template         = snapshot-%s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] split_loggers                  = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] state_path                     = /opt/stack/data/cinder {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] storage_availability_zone      = nova {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] storage_protocol               = iSCSI {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] syslog_log_facility            = LOG_USER {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] target_helper                  = lioadm {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] target_ip_address              = 192.168.122.140 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] target_port                    = 3260 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] target_protocol                = iscsi {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] target_secondary_ip_addresses  = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] trace_flags                    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] transport_url                  = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] until_refresh                  = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] use_chap_auth                  = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] use_default_quota_class        = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] use_journal                    = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] use_json                       = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] use_multipath_for_image_xfer   = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] use_stderr                     = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] use_syslog                     = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] verify_glance_signatures       = enabled {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] volume_api_class               = cinder.volume.api.API {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] volume_backend_name            = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] volume_clear                   = zero {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] volume_clear_ionice            = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] volume_clear_size              = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] volume_copy_bps_limit          = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] volume_dd_blocksize            = 1M {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] volume_name_template           = volume-%s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] volume_service_inithost_offload = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] volume_usage_audit_period      = month {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] zoning_mode                    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_concurrency.disable_process_locking = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.admin_password = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82616) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.admin_token = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.admin_user  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.auth_port   = 35357 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.auth_protocol = https {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.auth_section = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.auth_type   = password {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.auth_uri    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.auth_version = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.cache       = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.certfile    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.delay_auth_decision = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.http_connect_timeout = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.identity_uri = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.include_service_catalog = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.insecure    = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.interface   = public {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.keyfile     = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_password =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcache_username =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.region_name = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.service_token_roles_required = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.service_type = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.token_cache_time = 300 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.backend                  = dogpile.cache.null {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.backend_argument         = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.backend_expiration_time  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.config_prefix            = cache.oslo {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.debug_cache_backend      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.enable_retry_client      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.enable_socket_keepalive  = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.enabled                  = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.enforce_fips_mode        = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.expiration_time          = 600 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.hashclient_retry_attempts = 2 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.memcache_dead_retry      = 300 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.memcache_pool_maxsize    = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.memcache_sasl_enabled    = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.password                 = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.proxies                  = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.redis_db                 = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.redis_sentinel_service_name = mymaster {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.redis_server             = localhost:6379 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.retry_attempts           = 2 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.retry_delay              = 0.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.socket_keepalive_count   = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.socket_keepalive_idle    = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.socket_keepalive_interval = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.socket_timeout           = 1.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.tls_allowed_ciphers      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.tls_cafile               = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.tls_certfile             = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.tls_enabled              = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.tls_keyfile              = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cache.username                 = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] coordination.backend_url       = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.asyncio_connection    = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.asyncio_slave_connection = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.backend               = sqlalchemy {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.connection            = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.connection_debug      = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.connection_parameters =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.connection_recycle_time = 3600 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.connection_trace      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.db_inc_retry_interval = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.db_max_retries        = 20 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.db_max_retry_interval = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.db_retry_interval     = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.max_overflow          = 50 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.max_pool_size         = 5 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.max_retries           = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.mysql_wsrep_sync_wait = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.pool_timeout          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.retry_interval        = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.slave_connection      = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.sqlite_synchronous    = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.synchronous_reader    = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] database.use_db_reconnect      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler.connection_string     = messaging:// {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler.enabled               = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler.es_doc_type           = notification {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler.es_scroll_size        = 10000 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler.es_scroll_time        = 2m {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler.filter_error_trace    = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler.hmac_keys             = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler.sentinel_service_name = mymaster {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler.socket_timeout        = 0.1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler.trace_requests        = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler.trace_sqlalchemy      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler_jaeger.process_tags   = {} {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler_jaeger.service_name_prefix = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] profiler_otlp.service_name_prefix = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_policy.enforce_new_defaults = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: WARNING oslo_config.cfg [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_policy.enforce_scope      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_policy.policy_default_rule = default {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_policy.policy_file        = policy.yaml {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] privsep_osbrick.group          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] privsep_osbrick.helper_command = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] privsep_osbrick.user           = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cinder_sys_admin.group         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cinder_sys_admin.helper_command = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] cinder_sys_admin.user          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] service_user.auth_section      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] service_user.auth_type         = password {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] service_user.cafile            = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] service_user.certfile          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] service_user.collect_timing    = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] service_user.insecure          = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] service_user.keyfile           = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] service_user.send_service_user_token = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] service_user.split_loggers     = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] service_user.timeout           = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance.auth_section            = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance.auth_type               = password {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance.certfile                = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance.collect_timing          = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance.insecure                = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance.keyfile                 = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance.region_name             = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance.split_loggers           = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] glance.timeout                 = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.backend_availability_zone = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.chap_password = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.chap_username =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82616) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.disk_geometry = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.quobyte [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.driver_client_cert = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.driver_client_cert_key = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.driver_data_namespace = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.driver_use_ssl = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.enable_unsupported_driver = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.quobyte [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.extra_capabilities = {} {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.filter_function = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.goodness_function = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Running cmd (subprocess): mount.quobyte {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.iscsi_target_flags =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.iscsi_write_cache = on {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.iser_helper   = tgtadm {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.iser_port     = 3260 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.nas_host      =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.nas_login     = admin {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.nas_mount_options = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.nas_password  = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.nas_private_key =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.nas_share_path =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.num_shell_tries = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.nvmet_port_id = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.quobyte_client_cfg = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.quobyte_volume_url = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.replication_device = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.report_discard_supported = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.reserved_percentage = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.scst_target_driver = iscsi {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.scst_target_iqn_name = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.storage_protocol = iSCSI {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.target_helper = tgtadm {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.target_port   = 3260 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.target_protocol = iscsi {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.trace_flags   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.unique_fqdn_network = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.use_chap_auth = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.volume_backend_name = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.volume_clear  = zero {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.volume_clear_ionice = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.volume_clear_size = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_reports.file_event_handler = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_reports.log_dir           = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.backend_availability_zone = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.backend_host         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.chap_password        = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.chap_username        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.chiscsi_conf         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.disk_geometry        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.driver_client_cert   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.driver_client_cert_key = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.driver_data_namespace = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.driver_use_ssl       = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.extra_capabilities   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.filter_function      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.goodness_function    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.iser_helper          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.iser_ip_address      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.iser_port            = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.iser_target_prefix   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.nas_host             = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.nas_login            = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.nas_mount_options    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.nas_password         = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.nas_private_key      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.nas_share_path       = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.nas_ssh_port         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.num_shell_tries      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.nvmet_port_id        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.replication_device   = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.report_discard_supported = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.reserved_percentage  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.scst_target_driver   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.storage_protocol     = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.target_helper        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.target_ip_address    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.target_port          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.target_prefix        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.target_protocol      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.trace_flags          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.use_chap_auth        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.volume_clear         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.volume_clear_size    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] QuobyteHD.volumes_dir          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack quobyte-client[82635]: Reading configuration file: /etc/quobyte/client.cfg
Apr 16 19:46:08 devstack quobyte-client[82635]: Invalid parameters found, error: missing mount point.
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack quobyte-client[82635]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 16 19:46:08 devstack quobyte-client[82635]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.ssl      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_notifications.driver = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_notifications.retry = -1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] oslo_messaging_notifications.transport_url = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] key_manager.fixed_key          = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.barbican_api_version  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.barbican_endpoint     = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.barbican_endpoint_type = public {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.barbican_region_name  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.cafile                = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.certfile              = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.collect_timing        = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.insecure              = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.keyfile               = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.number_of_retries     = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.retry_delay           = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.send_service_user_token = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.split_loggers         = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.timeout               = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.verify_ssl            = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican.verify_ssl_path       = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican_service_user.auth_section = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican_service_user.auth_type = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican_service_user.cafile   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican_service_user.certfile = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican_service_user.collect_timing = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican_service_user.insecure = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican_service_user.keyfile  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican_service_user.split_loggers = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] barbican_service_user.timeout  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] vault.approle_role_id          = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] vault.approle_secret_id        = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] vault.kv_mountpoint            = secret {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] vault.kv_path                  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] vault.kv_version               = 2 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] vault.namespace                = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] vault.root_token_id            = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] vault.ssl_ca_crt_file          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] vault.timeout                  = 60.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] vault.use_ssl                  = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 19:46:08 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-2ce8e927-a2eb-4d82-abde-310bed687c5b None None] ******************************************************************************** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 16 19:46:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:46:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:46:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:46:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:46:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:46:08 devstack sudo[82642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:46:08 devstack sudo[82642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:46:09 devstack sudo[82642]: pam_unix(sudo:session): session closed for user root
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.432s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:46:09 devstack cinder-volume[82616]: INFO cinder.volume.driver [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Driver hasn't implemented _init_vendor_properties()
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG cinder.volume.driver [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5437622070312, 'free_capacity_gb': 1775.5437622070312, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82616) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG oslo_db.sqlalchemy.engines [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82616) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writer thread running {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG cinder.db.sqlalchemy.api [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Building query based on filter {{(pid=82616) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82616) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:46:09 devstack cinder-volume[82616]: INFO cinder.keymgr.migration [None req-8eb7207d-9e2c-4eb8-8aba-2b0e43e1b5eb None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 16 19:46:09 devstack sudo[82665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:46:09 devstack sudo[82665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:46:09 devstack sudo[82665]: pam_unix(sudo:session): session closed for user root
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.490s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:46:09 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:46:09 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Driver initialization completed successfully.
Apr 16 19:46:10 devstack cinder-volume[82616]: INFO cinder.manager [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Initiating service 3 cleanup
Apr 16 19:46:10 devstack cinder-volume[82616]: INFO cinder.manager [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Service 3 cleanup completed.
Apr 16 19:46:10 devstack cinder-volume[82616]: DEBUG cinder.service [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Creating RPC server for service cinder-volume {{(pid=82616) start /opt/stack/cinder/cinder/service.py:231}}
Apr 16 19:46:10 devstack cinder-volume[82616]: DEBUG cinder.service [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82616) start /opt/stack/cinder/cinder/service.py:237}}
Apr 16 19:46:10 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 16 19:46:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:46:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:46:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:46:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:46:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:46:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:46:10 devstack sudo[82676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:46:10 devstack sudo[82676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:46:10 devstack sudo[82676]: pam_unix(sudo:session): session closed for user root
Apr 16 19:46:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.432s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:46:10 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f1246df6-2634-4c20-a100-318dddde0862 None None] Driver post RPC initialization completed successfully.
Apr 16 19:46:18 devstack cinder-volume[82441]: DEBUG dbcounter [-] [82441] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82441) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:46:19 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=1 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:46:20 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:47:11 devstack cinder-volume[82616]: DEBUG oslo_service.periodic_task [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82616) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 19:47:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:47:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:47:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:11 devstack sudo[83099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:47:11 devstack sudo[83099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:12 devstack sudo[83099]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.511s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:12 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Flow 'volume_create_manager' (ccf53912-3a58-4139-a16e-d428431e3667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d45bd9-25dc-44dd-8364-9e8bf45e7715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d45bd9-25dc-44dd-8364-9e8bf45e7715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-137765968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f664b2-bd56-4d29-a104-9eac47a76e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f33abf6a9a421db5b99890971ca2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:21Z,use_quota=True,user_id='00363e1d052e404589e6270c6a9c0bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7169117b-ceba-45fa-adff-180c0349be66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7169117b-ceba-45fa-adff-180c0349be66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda9030e-ab9d-45b7-bffb-7491e0c875e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda9030e-ab9d-45b7-bffb-7491e0c875e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f664b2-bd56-4d29-a104-9eac47a76e7d', 'volume_name': 'volume-04f664b2-bd56-4d29-a104-9eac47a76e7d', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4a4b2f-5471-4c36-a5d2-5fa8d016d10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4a4b2f-5471-4c36-a5d2-5fa8d016d10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8474e773-8ee5-4e94-80bd-775a8a09d816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:21 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Volume 04f664b2-bd56-4d29-a104-9eac47a76e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f664b2-bd56-4d29-a104-9eac47a76e7d', 'volume_size': 1}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-137765968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f664b2-bd56-4d29-a104-9eac47a76e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f33abf6a9a421db5b99890971ca2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:21Z,use_quota=True,user_id='00363e1d052e404589e6270c6a9c0bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Creating volume 04f664b2-bd56-4d29-a104-9eac47a76e7d {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:47:21 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04f664b2-bd56-4d29-a104-9eac47a76e7d 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:21 devstack sudo[83159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04f664b2-bd56-4d29-a104-9eac47a76e7d 1073741824
Apr 16 19:47:21 devstack sudo[83159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Flow 'volume_create_manager' (f6632d82-b89a-4e4a-b926-643809c5b9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:47:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ec3272-867b-4b94-a4c4-041850e87bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ec3272-867b-4b94-a4c4-041850e87bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2044594231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bca0c94-45e9-4e56-93aa-6f561bd60364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b659ffc6b6b542098743a43433bdaabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:22Z,use_quota=True,user_id='8470a1e70b754edb83e3a8c9b2a98b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f548f2a-d48e-415f-a9c4-e12967cacffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f548f2a-d48e-415f-a9c4-e12967cacffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd74243-b082-4533-956e-61e155cebf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd74243-b082-4533-956e-61e155cebf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bca0c94-45e9-4e56-93aa-6f561bd60364', 'volume_name': 'volume-2bca0c94-45e9-4e56-93aa-6f561bd60364', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde528d0-1d8c-4b50-b1a9-11c5ab984fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde528d0-1d8c-4b50-b1a9-11c5ab984fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ebe0d3-9732-45d1-8ffa-ac2e83c4ad00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:22 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Volume 2bca0c94-45e9-4e56-93aa-6f561bd60364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bca0c94-45e9-4e56-93aa-6f561bd60364', 'volume_size': 1}
Apr 16 19:47:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:22 devstack sudo[83159]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04f664b2-bd56-4d29-a104-9eac47a76e7d 1073741824" returned: 0 in 1.141s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04f664b2-bd56-4d29-a104-9eac47a76e7d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:22 devstack sudo[83478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04f664b2-bd56-4d29-a104-9eac47a76e7d
Apr 16 19:47:22 devstack sudo[83478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:23 devstack sudo[83478]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04f664b2-bd56-4d29-a104-9eac47a76e7d" returned: 0 in 0.999s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.461s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2044594231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bca0c94-45e9-4e56-93aa-6f561bd60364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b659ffc6b6b542098743a43433bdaabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:22Z,use_quota=True,user_id='8470a1e70b754edb83e3a8c9b2a98b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Creating volume 2bca0c94-45e9-4e56-93aa-6f561bd60364 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:47:23 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8474e773-8ee5-4e94-80bd-775a8a09d816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f664b2-bd56-4d29-a104-9eac47a76e7d', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4343a3bc-1d02-4972-88df-9ca360e705de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:23 devstack sudo[83496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364 1073741824
Apr 16 19:47:23 devstack sudo[83496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:23 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Volume volume-04f664b2-bd56-4d29-a104-9eac47a76e7d (04f664b2-bd56-4d29-a104-9eac47a76e7d): created successfully
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4343a3bc-1d02-4972-88df-9ca360e705de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Flow 'volume_create_manager' (ccf53912-3a58-4139-a16e-d428431e3667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:47:23 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c36736be-a904-40e3-b8da-f99fadfb9b81 tempest-VolumesAdminNegativeTest-505226474 None] Created volume successfully.
Apr 16 19:47:24 devstack sudo[83496]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364 1073741824" returned: 0 in 0.901s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:24 devstack sudo[83511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364
Apr 16 19:47:24 devstack sudo[83511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Acquiring lock "cinder-04f664b2-bd56-4d29-a104-9eac47a76e7d-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:47:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Lock "cinder-04f664b2-bd56-4d29-a104-9eac47a76e7d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:47:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Acquiring lock "cinder-quobyte-04f664b2-bd56-4d29-a104-9eac47a76e7d" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:47:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Lock "cinder-quobyte-04f664b2-bd56-4d29-a104-9eac47a76e7d" acquired by "delete_volume" :: waited 0.042s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:47:25 devstack cinder-volume[82616]: INFO oslo.privsep.daemon [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvvtps95o/privsep.sock']
Apr 16 19:47:25 devstack sudo[83513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvvtps95o/privsep.sock
Apr 16 19:47:25 devstack sudo[83513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:25 devstack sudo[83511]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364" returned: 0 in 1.110s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:47:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ebe0d3-9732-45d1-8ffa-ac2e83c4ad00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bca0c94-45e9-4e56-93aa-6f561bd60364', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68adb249-74b6-4094-b959-a67637665f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:25 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Volume volume-2bca0c94-45e9-4e56-93aa-6f561bd60364 (2bca0c94-45e9-4e56-93aa-6f561bd60364): created successfully
Apr 16 19:47:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68adb249-74b6-4094-b959-a67637665f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Flow 'volume_create_manager' (f6632d82-b89a-4e4a-b926-643809c5b9f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:47:25 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-33bb0c62-6e15-45cd-a675-e90924f1a43a tempest-DeleteServersTestJSON-483903119 None] Created volume successfully.
Apr 16 19:47:25 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 16 19:47:25 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 16 19:47:25 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 16 19:47:25 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 16 19:47:25 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 16 19:47:25 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 16 19:47:25 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 16 19:47:25 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 16 19:47:25 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 16 19:47:26 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 16 19:47:26 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 16 19:47:26 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 16 19:47:26 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 16 19:47:26 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 16 19:47:26 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 16 19:47:26 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 16 19:47:26 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 16 19:47:26 devstack cinder-volume[82616]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 16 19:47:27 devstack sudo[83513]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:27 devstack cinder-volume[82616]: INFO oslo.privsep.daemon [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Spawned new privsep daemon via rootwrap
Apr 16 19:47:27 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Accepted privsep connection to /tmp/tmpvvtps95o/privsep.sock {{(pid=82616) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 16 19:47:27 devstack cinder-volume[82616]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 16 19:47:27 devstack cinder-volume[82616]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 16 19:47:27 devstack cinder-volume[82616]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 16 19:47:27 devstack cinder-volume[82616]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83524
Apr 16 19:47:27 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7258555-1cbc-4df5-a115-e4cda633f2fc]: (2,) {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:47:27 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c0c843-f749-4cc4-9ed4-7f37a0305776]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:47:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04f664b2-bd56-4d29-a104-9eac47a76e7d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:27 devstack sudo[83526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04f664b2-bd56-4d29-a104-9eac47a76e7d
Apr 16 19:47:27 devstack sudo[83526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:28 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-57e47df8-241f-48a5-8efc-3f0f7d2f5da5 tempest-GroupSnapshotsTest-148616543 None] Group tempest-GroupSnapshotsTest-Group-1507298371: creating
Apr 16 19:47:28 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-57e47df8-241f-48a5-8efc-3f0f7d2f5da5 tempest-GroupSnapshotsTest-148616543 None] Group tempest-GroupSnapshotsTest-Group-1507298371: created successfully
Apr 16 19:47:28 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-57e47df8-241f-48a5-8efc-3f0f7d2f5da5 tempest-GroupSnapshotsTest-148616543 None] Create group completed successfully.
Apr 16 19:47:28 devstack sudo[83526]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04f664b2-bd56-4d29-a104-9eac47a76e7d" returned: 0 in 1.160s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04f664b2-bd56-4d29-a104-9eac47a76e7d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:28 devstack sudo[83531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04f664b2-bd56-4d29-a104-9eac47a76e7d
Apr 16 19:47:28 devstack sudo[83531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:29 devstack sudo[83531]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04f664b2-bd56-4d29-a104-9eac47a76e7d" returned: 0 in 0.772s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Lock "cinder-quobyte-04f664b2-bd56-4d29-a104-9eac47a76e7d" released by "delete_volume" :: held 4.367s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:47:29 devstack cinder-volume[82616]: WARNING cinder.quota [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:47:29 devstack cinder-volume[82616]: WARNING cinder.quota [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:47:29 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Created reservations ['581e0cdb-adcb-4e07-ae71-5921643826fd', '50f00292-5215-4a1e-b2ad-6e5b88bad16b', '2ddc2e33-9e4c-4fa7-8040-9465fa540170', 'fe80778d-fb6c-4040-a03e-3d07fa246e36'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:47:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:47:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:47:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:30 devstack sudo[83536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:47:30 devstack sudo[83536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Flow 'volume_create_manager' (cacf2162-c9a8-4ec2-b131-35eec6ce29ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d49f23-ff79-4375-a142-c761484865c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d49f23-ff79-4375-a142-c761484865c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2104763968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d63ec4d1-f81b-48a0-8308-bcc27a70574e,host='devstack@QuobyteHD#QuobyteHD',id=0552c649-b5d6-4f7e-b25f-906d6f6f49b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b74d79805c4836aeea811aeccb0aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:30Z,use_quota=True,user_id='e567c3713d3b4f3caa3392590df11703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3e2ac46-a2ae-4df0-b47a-068287f34224),volume_type_id=c3e2ac46-a2ae-4df0-b47a-068287f34224)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78addf45-dd0a-49a9-9f84-0d0f500b8535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78addf45-dd0a-49a9-9f84-0d0f500b8535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0053fe47-4175-4ce2-875e-f91e70ea6db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0053fe47-4175-4ce2-875e-f91e70ea6db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0552c649-b5d6-4f7e-b25f-906d6f6f49b3', 'volume_name': 'volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89993ee-0620-46c7-9bb0-79594ac46ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89993ee-0620-46c7-9bb0-79594ac46ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973eba7b-2228-4e80-b54e-9d27cf0901b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:30 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Volume 0552c649-b5d6-4f7e-b25f-906d6f6f49b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3', 'volume_size': 1}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d63ec4d1-f81b-48a0-8308-bcc27a70574e,created_at=2026-04-16T17:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2104763968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d63ec4d1-f81b-48a0-8308-bcc27a70574e,host='devstack@QuobyteHD#QuobyteHD',id=0552c649-b5d6-4f7e-b25f-906d6f6f49b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b74d79805c4836aeea811aeccb0aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:30Z,use_quota=True,user_id='e567c3713d3b4f3caa3392590df11703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3e2ac46-a2ae-4df0-b47a-068287f34224),volume_type_id=c3e2ac46-a2ae-4df0-b47a-068287f34224)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Creating volume 0552c649-b5d6-4f7e-b25f-906d6f6f49b3 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:47:30 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:47:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:30 devstack sudo[83544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 1073741824
Apr 16 19:47:30 devstack sudo[83544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:31 devstack sudo[83536]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 1.564s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:31 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:47:31 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Deleted volume successfully.
Apr 16 19:47:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-03930ad6-77df-467c-ac03-73d1f905efa8 tempest-VolumesAdminNegativeTest-505226474 None] Lock "cinder-04f664b2-bd56-4d29-a104-9eac47a76e7d-delete_volume" released by "delete_volume" :: held 6.544s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:47:32 devstack sudo[83544]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 1073741824" returned: 0 in 2.231s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:32 devstack sudo[83585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3
Apr 16 19:47:32 devstack sudo[83585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:33 devstack cinder-volume[82616]: WARNING py.warnings [req-786505d4-adbc-4f13-8b54-e2b2a9e9842f req-51fa0bf2-5b20-4887-9f41-47d4f4aa4db8 tempest-DeleteServersTestJSON-483903119 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 16 19:47:33 devstack cinder-volume[82616]:   .first()
Apr 16 19:47:33 devstack cinder-volume[82616]: 
Apr 16 19:47:33 devstack sudo[83585]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-786505d4-adbc-4f13-8b54-e2b2a9e9842f req-51fa0bf2-5b20-4887-9f41-47d4f4aa4db8 tempest-DeleteServersTestJSON-483903119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3" returned: 0 in 1.100s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] <== create_volume: return (3400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:47:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.402s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-786505d4-adbc-4f13-8b54-e2b2a9e9842f req-51fa0bf2-5b20-4887-9f41-47d4f4aa4db8 tempest-DeleteServersTestJSON-483903119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973eba7b-2228-4e80-b54e-9d27cf0901b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba22889-ad4a-45dd-98f0-3fb3f8c52b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:33 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ac913c-93ce-48c9-80dc-2e35ef6cf8de]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:47:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-786505d4-adbc-4f13-8b54-e2b2a9e9842f req-51fa0bf2-5b20-4887-9f41-47d4f4aa4db8 tempest-DeleteServersTestJSON-483903119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:33 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Volume volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 (0552c649-b5d6-4f7e-b25f-906d6f6f49b3): created successfully
Apr 16 19:47:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba22889-ad4a-45dd-98f0-3fb3f8c52b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Flow 'volume_create_manager' (cacf2162-c9a8-4ec2-b131-35eec6ce29ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:47:33 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-24809c58-5ceb-4955-96ed-420ebff248c0 tempest-GroupSnapshotsTest-148616543 None] Created volume successfully.
Apr 16 19:47:33 devstack sudo[83602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364
Apr 16 19:47:33 devstack sudo[83602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:34 devstack sudo[83602]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-786505d4-adbc-4f13-8b54-e2b2a9e9842f req-51fa0bf2-5b20-4887-9f41-47d4f4aa4db8 tempest-DeleteServersTestJSON-483903119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364" returned: 0 in 0.783s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-786505d4-adbc-4f13-8b54-e2b2a9e9842f req-51fa0bf2-5b20-4887-9f41-47d4f4aa4db8 tempest-DeleteServersTestJSON-483903119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.805s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-786505d4-adbc-4f13-8b54-e2b2a9e9842f req-51fa0bf2-5b20-4887-9f41-47d4f4aa4db8 tempest-DeleteServersTestJSON-483903119 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de', 'name': 'volume-2bca0c94-45e9-4e56-93aa-6f561bd60364', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72d5d2f7-568f-4e5f-a6ed-d9c5d4599a53', 'enforce_multipath': True} {{(pid=82616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 16 19:47:34 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-786505d4-adbc-4f13-8b54-e2b2a9e9842f req-51fa0bf2-5b20-4887-9f41-47d4f4aa4db8 tempest-DeleteServersTestJSON-483903119 None] attachment_update completed successfully.
Apr 16 19:47:35 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] GroupSnapshot f632f5e7-f0f2-4280-80fe-4207037e09db: creating.
Apr 16 19:47:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] Group snapshot f632f5e7-f0f2-4280-80fe-4207037e09db: creating. {{(pid=82616) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 16 19:47:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] Creating offline snapshot d2bd3147-02ff-4650-9bec-6b427da36c1f of volume 0552c649-b5d6-4f7e-b25f-906d6f6f49b3 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:47:35 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[21af6744-1cb5-402f-aa5f-8d2b2e9920c2]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:47:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:35 devstack sudo[83611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3
Apr 16 19:47:35 devstack sudo[83611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:35 devstack sudo[83611]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3" returned: 0 in 0.671s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:35 devstack sudo[83684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f 1G
Apr 16 19:47:35 devstack sudo[83684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:36 devstack sudo[83684]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f 1G" returned: 0 in 0.616s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:36 devstack sudo[84005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f
Apr 16 19:47:36 devstack sudo[84005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:37 devstack sudo[84005]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f" returned: 0 in 0.922s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:37 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:47:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:37 devstack sudo[84011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f
Apr 16 19:47:37 devstack sudo[84011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:37 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:47:37 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Flow 'volume_create_manager' (147f9b8d-021a-474b-9c3e-bafb10a519c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:47:37 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eeec32e-ab3e-4ed7-b954-52b10fe45b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:37 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eeec32e-ab3e-4ed7-b954-52b10fe45b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:47:37Z,deleted=False,deleted_at=None,display_description='',display_name='2251fa4c-f597-47b6-91c0-2dc1ac13c9aa-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69baa5d7-12c9-4f79-95b0-30f5324a62c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9114946bee2a4b44ae35f332d8c5b6d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:38Z,use_quota=True,user_id='23efb2cb268d4fe5adbd023282be05ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:37 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f4e503-75e5-4ac8-bf39-777ee993ae7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:37 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f4e503-75e5-4ac8-bf39-777ee993ae7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:37 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe920152-b331-4c99-8d3f-c7ba3077f5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:37 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe920152-b331-4c99-8d3f-c7ba3077f5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69baa5d7-12c9-4f79-95b0-30f5324a62c0', 'volume_name': 'volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1108209-5ebe-4734-9134-8c9f72211eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1108209-5ebe-4734-9134-8c9f72211eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:38 devstack sudo[84011]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc46fc4-5a77-4fb7-8262-983bdc3f8b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:38 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Volume 69baa5d7-12c9-4f79-95b0-30f5324a62c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0', 'volume_size': 1}
Apr 16 19:47:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f" returned: 0 in 0.752s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:38 devstack sudo[84014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.info
Apr 16 19:47:38 devstack sudo[84014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:38 devstack sudo[84014]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.info" returned: 0 in 0.896s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:39 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:39 devstack sudo[84020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.info
Apr 16 19:47:39 devstack sudo[84020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:39 devstack sudo[84020]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.info" returned: 0 in 0.693s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.638s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.688s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:47:37Z,deleted=False,deleted_at=None,display_description='',display_name='2251fa4c-f597-47b6-91c0-2dc1ac13c9aa-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69baa5d7-12c9-4f79-95b0-30f5324a62c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9114946bee2a4b44ae35f332d8c5b6d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:38Z,use_quota=True,user_id='23efb2cb268d4fe5adbd023282be05ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Creating volume 69baa5d7-12c9-4f79-95b0-30f5324a62c0 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:47:39 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:47:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:39 devstack sudo[84025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0 1073741824
Apr 16 19:47:39 devstack sudo[84025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:39 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-24331644-c027-4c6d-8c59-2b3689d9b61a tempest-GroupSnapshotsTest-148616543 None] group_snapshot f632f5e7-f0f2-4280-80fe-4207037e09db: created successfully
Apr 16 19:47:40 devstack sudo[84025]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0 1073741824" returned: 0 in 0.985s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:40 devstack sudo[84031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0
Apr 16 19:47:40 devstack sudo[84031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:41 devstack sudo[84031]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0" returned: 0 in 0.620s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:47:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc46fc4-5a77-4fb7-8262-983bdc3f8b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ba4ad4-e999-4921-888c-2784cd0583ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:41 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Volume volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0 (69baa5d7-12c9-4f79-95b0-30f5324a62c0): created successfully
Apr 16 19:47:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ba4ad4-e999-4921-888c-2784cd0583ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Flow 'volume_create_manager' (147f9b8d-021a-474b-9c3e-bafb10a519c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:47:41 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-aad9bcd3-d72f-470e-8e8c-afb8165c29fa tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Created volume successfully.
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-d2bd3147-02ff-4650-9bec-6b427da36c1f-35f50d52-b4b7-4c6d-abc2-9797efcf15e6" by "_create_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-d2bd3147-02ff-4650-9bec-6b427da36c1f-35f50d52-b4b7-4c6d-abc2-9797efcf15e6" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Creating volume 35f50d52-b4b7-4c6d-abc2-9797efcf15e6 from snapshot d2bd3147-02ff-4650-9bec-6b427da36c1f {{(pid=82616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-35f50d52-b4b7-4c6d-abc2-9797efcf15e6" by "_copy_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-35f50d52-b4b7-4c6d-abc2-9797efcf15e6" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] snapshot: d2bd3147-02ff-4650-9bec-6b427da36c1f, volume: 35f50d52-b4b7-4c6d-abc2-9797efcf15e6,  {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef05f14f-e04d-4550-8d5c-9d0c27344e29]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:42 devstack sudo[84085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f
Apr 16 19:47:42 devstack sudo[84085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:42 devstack sudo[84085]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f" returned: 0 in 0.577s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Creating direct copy from snapshot {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bdb830-206c-49ac-8844-d7516b43662e]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:47:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:42 devstack sudo[84093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3
Apr 16 19:47:43 devstack sudo[84093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:43 devstack sudo[84093]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3" returned: 0 in 0.771s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:43 devstack cinder-volume[82616]: DEBUG cinder.utils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Path /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6 not found in is_blk_device check {{(pid=82616) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 19:47:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:43 devstack sudo[84106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6
Apr 16 19:47:43 devstack sudo[84106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:44 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-896fd9a6-cf84-4fac-93f2-164c12c05942 req-a704399d-cd76-427e-a316-1e181b061f77 tempest-DeleteServersTestJSON-483903119 None] Terminate volume connection completed successfully.
Apr 16 19:47:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-896fd9a6-cf84-4fac-93f2-164c12c05942 req-a704399d-cd76-427e-a316-1e181b061f77 tempest-DeleteServersTestJSON-483903119 None] Deleting attachment 72d5d2f7-568f-4e5f-a6ed-d9c5d4599a53. {{(pid=82616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 16 19:47:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-0c7a8359-58ba-49f6-a9cd-97aaa77d58c3 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:47 devstack sudo[84106]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6" returned: 0 in 3.902s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:47 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2857d6ea-4db9-4402-b235-77aa9b4450d9]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:47:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:47 devstack sudo[84157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3
Apr 16 19:47:47 devstack sudo[84157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:48 devstack sudo[84157]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3" returned: 0 in 0.820s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:48 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3, size 1024.00 MB, duration 3.90 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:47:48 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Converted 1024.00 MB image at 262.28 MB/s
Apr 16 19:47:48 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6 is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:47:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:48 devstack sudo[84162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6
Apr 16 19:47:48 devstack sudo[84162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:49 devstack sudo[84162]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6" returned: 0 in 0.678s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-35f50d52-b4b7-4c6d-abc2-9797efcf15e6" released by "_copy_volume_from_snapshot" :: held 6.831s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-d2bd3147-02ff-4650-9bec-6b427da36c1f-35f50d52-b4b7-4c6d-abc2-9797efcf15e6" released by "_create_volume_from_snapshot" :: held 6.862s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.877s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-0c7a8359-58ba-49f6-a9cd-97aaa77d58c3 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.567s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd20607b-fcce-4a30-9067-7ca4301eb3cf]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-0c7a8359-58ba-49f6-a9cd-97aaa77d58c3 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:49 devstack sudo[84166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0
Apr 16 19:47:49 devstack sudo[84166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Acquiring lock "cinder-2bca0c94-45e9-4e56-93aa-6f561bd60364-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Lock "cinder-2bca0c94-45e9-4e56-93aa-6f561bd60364-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:47:49 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0d999f8c-7f1b-4664-aac5-7202de2f34fa tempest-GroupSnapshotsTest-148616543 None] Create group from source-snapshot-f632f5e7-f0f2-4280-80fe-4207037e09db completed successfully.
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Acquiring lock "cinder-quobyte-2bca0c94-45e9-4e56-93aa-6f561bd60364" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Lock "cinder-quobyte-2bca0c94-45e9-4e56-93aa-6f561bd60364" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6063d20-ec17-4a31-80ff-969a7334402c]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:49 devstack sudo[84169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364
Apr 16 19:47:49 devstack sudo[84169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:49 devstack sudo[84166]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-0c7a8359-58ba-49f6-a9cd-97aaa77d58c3 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0" returned: 0 in 0.826s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-0c7a8359-58ba-49f6-a9cd-97aaa77d58c3 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.838s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-0c7a8359-58ba-49f6-a9cd-97aaa77d58c3 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de', 'name': 'volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96112a2f-c775-42a4-aabb-08ce2ab81514', 'enforce_multipath': True} {{(pid=82616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 16 19:47:50 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-39a1dd19-2d11-42f6-8862-4f405a7d71e2 req-0c7a8359-58ba-49f6-a9cd-97aaa77d58c3 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] attachment_update completed successfully.
Apr 16 19:47:50 devstack sudo[84169]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364" returned: 0 in 0.710s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:50 devstack sudo[84178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364
Apr 16 19:47:50 devstack sudo[84178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-35f50d52-b4b7-4c6d-abc2-9797efcf15e6" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-35f50d52-b4b7-4c6d-abc2-9797efcf15e6" acquired by "delete_volume" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[208517bb-baee-4bea-ad83-6c7d6b8d7b63]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:50 devstack sudo[84180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6
Apr 16 19:47:50 devstack sudo[84180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:50 devstack sudo[84178]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2bca0c94-45e9-4e56-93aa-6f561bd60364" returned: 0 in 0.583s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Lock "cinder-quobyte-2bca0c94-45e9-4e56-93aa-6f561bd60364" released by "delete_volume" :: held 1.319s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Created reservations ['55bba327-2eb7-4463-a396-1846bca398d9', '65d78f38-438d-4f50-962c-8ddf7da71665', '46c14539-07a3-4152-82c9-c3340b361e4f', 'f01ea701-4c5d-4804-b4ab-b51f3d70890c'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:50 devstack sudo[84184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:47:50 devstack sudo[84184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:51 devstack sudo[84180]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6" returned: 0 in 0.727s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:51 devstack sudo[84189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6
Apr 16 19:47:51 devstack sudo[84189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:51 devstack sudo[84189]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-35f50d52-b4b7-4c6d-abc2-9797efcf15e6" returned: 0 in 0.602s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-35f50d52-b4b7-4c6d-abc2-9797efcf15e6" released by "delete_volume" :: held 1.379s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:47:51 devstack sudo[84184]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.924s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:47:51 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Deleted volume successfully.
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5eb53e38-f79d-4954-84fc-0ad9d369b059 tempest-DeleteServersTestJSON-483903119 None] Lock "cinder-2bca0c94-45e9-4e56-93aa-6f561bd60364-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Created reservations ['fd89e8b4-9e95-4647-bbdf-5abfcf21791d'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:47:51 devstack cinder-volume[82616]: WARNING cinder.quota [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-477854516 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-477854516, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:47:51 devstack cinder-volume[82616]: WARNING cinder.quota [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-477854516 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-477854516, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Created reservations ['6aae9fe7-3e71-4117-8a49-59757cbf32ab', 'bad15d1d-b06d-4636-b523-ae3c913b7469', '23cc86a4-79fc-4e0a-8fc1-c61232b4689a', 'f66d7383-b43c-4d57-be25-d8e878b837db'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:51 devstack sudo[84193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:47:51 devstack sudo[84193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:52 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] group_snapshot f632f5e7-f0f2-4280-80fe-4207037e09db: deleting
Apr 16 19:47:52 devstack sudo[84193]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] group_snapshot f632f5e7-f0f2-4280-80fe-4207037e09db: deleting {{(pid=82616) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 16 19:47:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.951s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:52 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:47:52 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-dad25f1b-2af5-4251-beef-83dc7bc6e979 tempest-GroupSnapshotsTest-148616543 None] Delete group completed successfully.
Apr 16 19:47:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-0552c649-b5d6-4f7e-b25f-906d6f6f49b3" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:47:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-0552c649-b5d6-4f7e-b25f-906d6f6f49b3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:47:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-d2bd3147-02ff-4650-9bec-6b427da36c1f" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:47:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-d2bd3147-02ff-4650-9bec-6b427da36c1f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:47:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Deleting offline snapshot d2bd3147-02ff-4650-9bec-6b427da36c1f of volume 0552c649-b5d6-4f7e-b25f-906d6f6f49b3 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:47:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] snapshot_file for this snap is: volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:47:52 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c88d81-a25f-4734-8b61-9886b0843d97]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:47:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:53 devstack sudo[84264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f
Apr 16 19:47:53 devstack sudo[84264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:53 devstack sudo[84264]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f" returned: 0 in 0.862s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:47:53 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[58351bec-8d92-46d0-ae5e-7a96a0006eb5]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:47:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:53 devstack sudo[84273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3
Apr 16 19:47:53 devstack sudo[84273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:54 devstack sudo[84273]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3" returned: 0 in 0.687s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:54 devstack sudo[84279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f
Apr 16 19:47:54 devstack sudo[84279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:55 devstack sudo[84279]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f" returned: 0 in 0.901s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:55 devstack sudo[84620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f
Apr 16 19:47:55 devstack sudo[84620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:56 devstack sudo[84620]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3.d2bd3147-02ff-4650-9bec-6b427da36c1f" returned: 0 in 1.072s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-d2bd3147-02ff-4650-9bec-6b427da36c1f" released by "_delete_snapshot" :: held 3.597s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:47:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-0552c649-b5d6-4f7e-b25f-906d6f6f49b3" released by "delete_snapshot" :: held 3.612s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:47:56 devstack cinder-volume[82616]: WARNING cinder.quota [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-477854516 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-477854516, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:47:56 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] Created reservations ['eda03524-2b45-4fc2-a114-6709b2c25251', 'a2ff507e-1ab9-4f24-afcf-a93780e94c21', 'c42f1ad5-10aa-456a-a085-bf625a09ebbb', 'ac935104-9995-4575-8609-f444b4e4e0f4'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:47:56 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-4dab9862-5dfe-4787-9f73-1a966155a7b0 tempest-GroupSnapshotsTest-148616543 None] group_snapshot f632f5e7-f0f2-4280-80fe-4207037e09db: deleted successfully
Apr 16 19:47:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-0552c649-b5d6-4f7e-b25f-906d6f6f49b3" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:47:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-0552c649-b5d6-4f7e-b25f-906d6f6f49b3" acquired by "delete_volume" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:47:57 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af641f8-6001-451e-a1f1-f9aa524c1937]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:47:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:57 devstack sudo[84629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3
Apr 16 19:47:57 devstack sudo[84629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:58 devstack sudo[84629]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3" returned: 0 in 0.994s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:58 devstack sudo[84635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3
Apr 16 19:47:58 devstack sudo[84635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Flow 'volume_create_manager' (d11a3f6b-2b74-4a54-a53d-4c0e9a41549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbb8f9e-5b33-44be-a053-ec61c08fb70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbb8f9e-5b33-44be-a053-ec61c08fb70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1240395797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a88b98-8967-44b2-bc9d-4c1e71c9735d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='889a24fd4ff049d9a10f41f9adf12505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:59Z,use_quota=True,user_id='6fbbe34dd6624cc5a25a669a6f66781b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf59bd61-0116-4c7f-9229-35203b887859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf59bd61-0116-4c7f-9229-35203b887859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bed597-fa2c-4151-982a-e5276d1fa5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bed597-fa2c-4151-982a-e5276d1fa5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a88b98-8967-44b2-bc9d-4c1e71c9735d', 'volume_name': 'volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967e78f0-91ee-488b-a2bf-c9b9019c11f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967e78f0-91ee-488b-a2bf-c9b9019c11f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6357f6da-f06d-4fdf-94ee-87e43cfc3e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:47:59 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Volume d7a88b98-8967-44b2-bc9d-4c1e71c9735d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d', 'volume_size': 1}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1240395797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a88b98-8967-44b2-bc9d-4c1e71c9735d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='889a24fd4ff049d9a10f41f9adf12505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:59Z,use_quota=True,user_id='6fbbe34dd6624cc5a25a669a6f66781b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Creating volume d7a88b98-8967-44b2-bc9d-4c1e71c9735d {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:47:59 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:59 devstack sudo[84638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d 1073741824
Apr 16 19:47:59 devstack sudo[84638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:59 devstack sudo[84635]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0552c649-b5d6-4f7e-b25f-906d6f6f49b3" returned: 0 in 0.653s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-0552c649-b5d6-4f7e-b25f-906d6f6f49b3" released by "delete_volume" :: held 1.702s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Created reservations ['7ee552c1-2521-4e27-be6b-91265d22f50e'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:47:59 devstack cinder-volume[82616]: WARNING cinder.db.sqlalchemy.api [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-477854516']
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Created reservations ['c4010c34-e329-4d3a-b304-aba78d44234e', '0afe36ac-bbc1-4fb2-a1e4-6b1e84b55053', '8fb361a2-4a7c-41ec-9f76-c65d92603d89', 'a754a46a-74a5-42e0-b238-4948ac43860f'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:47:59 devstack sudo[84641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:47:59 devstack sudo[84641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:47:59 devstack sudo[84638]: pam_unix(sudo:session): session closed for user root
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d 1073741824" returned: 0 in 0.670s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:47:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:00 devstack sudo[84646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d
Apr 16 19:48:00 devstack sudo[84646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:00 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f68cb87c-f40d-4a28-b663-49449f43d40a tempest-GroupSnapshotsTest-148616543 None] Group tempest-GroupSnapshotsTest-Group-1889521493: creating
Apr 16 19:48:00 devstack sudo[84641]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.838s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:00 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:48:00 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-cb96578f-eddb-4302-9cff-3d1a8e7d36b6 tempest-GroupSnapshotsTest-148616543 None] Delete group completed successfully.
Apr 16 19:48:00 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f68cb87c-f40d-4a28-b663-49449f43d40a tempest-GroupSnapshotsTest-148616543 None] Group tempest-GroupSnapshotsTest-Group-1889521493: created successfully
Apr 16 19:48:00 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f68cb87c-f40d-4a28-b663-49449f43d40a tempest-GroupSnapshotsTest-148616543 None] Create group completed successfully.
Apr 16 19:48:00 devstack sudo[84646]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d" returned: 0 in 0.630s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:48:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6357f6da-f06d-4fdf-94ee-87e43cfc3e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861b70e1-f8c4-4260-b070-68d63385b288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:00 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Volume volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d (d7a88b98-8967-44b2-bc9d-4c1e71c9735d): created successfully
Apr 16 19:48:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861b70e1-f8c4-4260-b070-68d63385b288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Flow 'volume_create_manager' (d11a3f6b-2b74-4a54-a53d-4c0e9a41549f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:48:00 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-aee225b4-dd5e-43db-b601-f5290d087b49 req-3bffadef-9c26-41ef-b2a1-50b9cbc30a42 tempest-VolumesSnapshotsTestJSON-1965595929 None] Created volume successfully.
Apr 16 19:48:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] Creating offline snapshot 570ddf0e-1843-4f63-a355-83c7dee8f7c4 of volume d7a88b98-8967-44b2-bc9d-4c1e71c9735d {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:48:01 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4243c8d6-b9f6-4dc8-9592-2d107f4cc50d]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:01 devstack sudo[84684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d
Apr 16 19:48:01 devstack sudo[84684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Flow 'volume_create_manager' (85ee6c4b-b1b6-4f4c-86b7-f0713e81d1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28c46aa-aced-4fec-aa16-178b2c8f17d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28c46aa-aced-4fec-aa16-178b2c8f17d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2062369234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=32d163f6-669f-4f86-8a02-7f51c2672d7e,host='devstack@QuobyteHD#QuobyteHD',id=59db9063-7cc6-46dd-bc40-0c8198ab8379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b74d79805c4836aeea811aeccb0aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:02Z,use_quota=True,user_id='e567c3713d3b4f3caa3392590df11703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a772f1-1e2c-4162-afdf-368e9eadccdb),volume_type_id=45a772f1-1e2c-4162-afdf-368e9eadccdb)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792c1e57-b410-4e82-bf05-18dcea0b3564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792c1e57-b410-4e82-bf05-18dcea0b3564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49b3381-4b4d-42da-940e-45704d75d2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49b3381-4b4d-42da-940e-45704d75d2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59db9063-7cc6-46dd-bc40-0c8198ab8379', 'volume_name': 'volume-59db9063-7cc6-46dd-bc40-0c8198ab8379', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfc69bd-8631-4e65-92de-7cd2a0c30d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfc69bd-8631-4e65-92de-7cd2a0c30d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0960accc-411f-46a3-9498-43620ad9e7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:02 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Volume 59db9063-7cc6-46dd-bc40-0c8198ab8379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59db9063-7cc6-46dd-bc40-0c8198ab8379', 'volume_size': 1}
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:02 devstack sudo[84684]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d" returned: 0 in 0.837s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:02 devstack sudo[84689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4 1G
Apr 16 19:48:02 devstack sudo[84689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:03 devstack sudo[84689]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4 1G" returned: 0 in 0.922s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:03 devstack sudo[84716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4
Apr 16 19:48:03 devstack sudo[84716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:04 devstack sudo[84716]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4" returned: 0 in 0.645s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:04 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4 is being set with open permissions: ugo+rw
Apr 16 19:48:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:04 devstack sudo[84721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4
Apr 16 19:48:04 devstack sudo[84721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:04 devstack sudo[84721]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4" returned: 0 in 0.726s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:04 devstack sudo[84740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.info
Apr 16 19:48:04 devstack sudo[84740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:05 devstack sudo[84740]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.info" returned: 0 in 0.631s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:05 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.info is being set with open permissions: ugo+rw
Apr 16 19:48:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:05 devstack sudo[84749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.info
Apr 16 19:48:05 devstack sudo[84749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:06 devstack sudo[84749]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.info" returned: 0 in 0.537s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.404s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.826s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=32d163f6-669f-4f86-8a02-7f51c2672d7e,created_at=2026-04-16T17:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2062369234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=32d163f6-669f-4f86-8a02-7f51c2672d7e,host='devstack@QuobyteHD#QuobyteHD',id=59db9063-7cc6-46dd-bc40-0c8198ab8379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b74d79805c4836aeea811aeccb0aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:02Z,use_quota=True,user_id='e567c3713d3b4f3caa3392590df11703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a772f1-1e2c-4162-afdf-368e9eadccdb),volume_type_id=45a772f1-1e2c-4162-afdf-368e9eadccdb)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Creating volume 59db9063-7cc6-46dd-bc40-0c8198ab8379 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:48:06 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:06 devstack sudo[84752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379 1073741824
Apr 16 19:48:06 devstack sudo[84752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:06 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-78f6e5d2-42f9-428f-b03f-90f665dd12f8 req-d2a99882-969c-4cee-b3b0-ce13eb4583b4 tempest-VolumesSnapshotsTestJSON-1965595929 None] Create snapshot completed successfully
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Acquiring lock "cinder-570ddf0e-1843-4f63-a355-83c7dee8f7c4-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "cinder-570ddf0e-1843-4f63-a355-83c7dee8f7c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Acquiring lock "cinder-quobyte-d7a88b98-8967-44b2-bc9d-4c1e71c9735d" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "cinder-quobyte-d7a88b98-8967-44b2-bc9d-4c1e71c9735d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Acquiring lock "cinder-quobyte-570ddf0e-1843-4f63-a355-83c7dee8f7c4" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "cinder-quobyte-570ddf0e-1843-4f63-a355-83c7dee8f7c4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Deleting offline snapshot 570ddf0e-1843-4f63-a355-83c7dee8f7c4 of volume d7a88b98-8967-44b2-bc9d-4c1e71c9735d {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] snapshot_file for this snap is: volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[df30c0b7-0f65-46fe-8281-26bf041acc88]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:06 devstack sudo[84754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4
Apr 16 19:48:06 devstack sudo[84754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:06 devstack sudo[84752]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379 1073741824" returned: 0 in 0.834s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:07 devstack sudo[84759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379
Apr 16 19:48:07 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:07 devstack sudo[84754]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4" returned: 0 in 0.696s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:48:07 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bd0850-654e-448d-8561-897a4fb74132]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:07 devstack sudo[84764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d
Apr 16 19:48:07 devstack sudo[84764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:07 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379" returned: 0 in 0.647s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:48:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0960accc-411f-46a3-9498-43620ad9e7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59db9063-7cc6-46dd-bc40-0c8198ab8379', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0738c74f-2f6c-4757-bf48-876eac2016b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:07 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Volume volume-59db9063-7cc6-46dd-bc40-0c8198ab8379 (59db9063-7cc6-46dd-bc40-0c8198ab8379): created successfully
Apr 16 19:48:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0738c74f-2f6c-4757-bf48-876eac2016b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Flow 'volume_create_manager' (85ee6c4b-b1b6-4f4c-86b7-f0713e81d1bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:48:07 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-86485dab-a507-48bb-851d-a1cc361038eb tempest-GroupSnapshotsTest-148616543 None] Created volume successfully.
Apr 16 19:48:07 devstack sudo[84764]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d" returned: 0 in 0.674s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:07 devstack sudo[84773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4
Apr 16 19:48:07 devstack sudo[84773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:08 devstack sudo[84773]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4" returned: 0 in 0.586s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:08 devstack sudo[84782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4
Apr 16 19:48:08 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:08 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d.570ddf0e-1843-4f63-a355-83c7dee8f7c4" returned: 0 in 0.467s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "cinder-quobyte-570ddf0e-1843-4f63-a355-83c7dee8f7c4" released by "_delete_snapshot" :: held 2.510s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "cinder-quobyte-d7a88b98-8967-44b2-bc9d-4c1e71c9735d" released by "delete_snapshot" :: held 2.532s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:08 devstack cinder-volume[82616]: WARNING cinder.quota [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:48:08 devstack cinder-volume[82616]: DEBUG cinder.quota [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Created reservations ['7e87ba9d-44f2-4bc7-aac2-f0c87c84fc75', 'a7c79538-b9a1-4473-9b0d-3a12fb4c76bf', 'e98f21cc-6156-4205-8998-33d4e39645fc', '695f2d68-e3ee-4ca9-8de0-d22fd0278301'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:48:09 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Delete snapshot completed successfully.
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-d5c0d83a-abed-4ffc-8cdc-74ad161c05af req-352c9efd-4ec7-4609-b6a3-3dc13d12bb81 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "cinder-570ddf0e-1843-4f63-a355-83c7dee8f7c4-delete_snapshot" released by "delete_snapshot" :: held 2.673s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Flow 'volume_create_manager' (aa60e95c-41a7-4bba-b5c9-156fa6d1ef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06cfa81-b416-4a92-9efb-eeff92279c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06cfa81-b416-4a92-9efb-eeff92279c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1340804338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=32d163f6-669f-4f86-8a02-7f51c2672d7e,host='devstack@QuobyteHD#QuobyteHD',id=4fdd4301-35a4-4b67-84c4-57a7faa18f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b74d79805c4836aeea811aeccb0aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:09Z,use_quota=True,user_id='e567c3713d3b4f3caa3392590df11703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a772f1-1e2c-4162-afdf-368e9eadccdb),volume_type_id=45a772f1-1e2c-4162-afdf-368e9eadccdb)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e139dd-0f40-4561-91ae-3d47cad4060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e139dd-0f40-4561-91ae-3d47cad4060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44c18af-5e36-49ec-b6f3-8ba709851c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44c18af-5e36-49ec-b6f3-8ba709851c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fdd4301-35a4-4b67-84c4-57a7faa18f8f', 'volume_name': 'volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15253db-ef75-4919-9425-64dbe3d969cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15253db-ef75-4919-9425-64dbe3d969cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2bab53-18ba-41bd-b258-3f78e08a88ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:09 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Volume 4fdd4301-35a4-4b67-84c4-57a7faa18f8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f', 'volume_size': 1}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=32d163f6-669f-4f86-8a02-7f51c2672d7e,created_at=2026-04-16T17:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1340804338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=32d163f6-669f-4f86-8a02-7f51c2672d7e,host='devstack@QuobyteHD#QuobyteHD',id=4fdd4301-35a4-4b67-84c4-57a7faa18f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b74d79805c4836aeea811aeccb0aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:09Z,use_quota=True,user_id='e567c3713d3b4f3caa3392590df11703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a772f1-1e2c-4162-afdf-368e9eadccdb),volume_type_id=45a772f1-1e2c-4162-afdf-368e9eadccdb)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Creating volume 4fdd4301-35a4-4b67-84c4-57a7faa18f8f {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:48:09 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:09 devstack sudo[84788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f 1073741824
Apr 16 19:48:09 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Acquiring lock "cinder-d7a88b98-8967-44b2-bc9d-4c1e71c9735d-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "cinder-d7a88b98-8967-44b2-bc9d-4c1e71c9735d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Acquiring lock "cinder-quobyte-d7a88b98-8967-44b2-bc9d-4c1e71c9735d" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "cinder-quobyte-d7a88b98-8967-44b2-bc9d-4c1e71c9735d" acquired by "delete_volume" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf2eda4-6f3e-43d7-b94c-578892804f1a]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:09 devstack sudo[84818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d
Apr 16 19:48:09 devstack sudo[84818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:10 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f 1073741824" returned: 0 in 1.052s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:10 devstack sudo[84823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f
Apr 16 19:48:10 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:10 devstack sudo[84818]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d" returned: 0 in 0.747s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:10 devstack sudo[84828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d
Apr 16 19:48:10 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:10 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f" returned: 0 in 0.624s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:48:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2bab53-18ba-41bd-b258-3f78e08a88ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04dd48f3-147f-4577-bdba-3ac39e40571c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:10 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Volume volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f (4fdd4301-35a4-4b67-84c4-57a7faa18f8f): created successfully
Apr 16 19:48:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04dd48f3-147f-4577-bdba-3ac39e40571c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Flow 'volume_create_manager' (aa60e95c-41a7-4bba-b5c9-156fa6d1ef10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:48:10 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-e044a221-37e0-430a-81e6-ec60e5419360 tempest-GroupSnapshotsTest-148616543 None] Created volume successfully.
Apr 16 19:48:11 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a88b98-8967-44b2-bc9d-4c1e71c9735d" returned: 0 in 0.552s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "cinder-quobyte-d7a88b98-8967-44b2-bc9d-4c1e71c9735d" released by "delete_volume" :: held 1.393s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG cinder.quota [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Created reservations ['1a74cd63-ecf8-4a10-b80f-776dabc37011', 'bed60df2-a5a4-4628-a8e1-997067814d61', '6895d068-1265-4a09-9e49-467f6efa1a3e', '00c2e0a8-e61f-40ab-9e6f-e6f849419866'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:11 devstack sudo[84833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:48:11 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG oslo_service.periodic_task [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82616) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:11 devstack sudo[84835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:48:11 devstack sudo[84835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:11 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-28cd0c5a-d2e9-4eaa-8383-1a503f75b8c1 tempest-GroupSnapshotsTest-148616543 None] Update group completed successfully.
Apr 16 19:48:11 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.586s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG cinder.manager [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:48:11 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Deleted volume successfully.
Apr 16 19:48:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-5d0d6a5e-1fc8-43d6-b52b-9715a4c2570d req-aa7a7492-d3f8-4646-8f99-6803b5bd91d8 tempest-VolumesSnapshotsTestJSON-1965595929 None] Lock "cinder-d7a88b98-8967-44b2-bc9d-4c1e71c9735d-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:12 devstack sudo[84835]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.599s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:12 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:48:12 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7bb9f245-a8f2-42d7-a301-2d8993cc7304 tempest-GroupSnapshotsTest-148616543 None] Update group completed successfully.
Apr 16 19:48:14 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f805ba8c-f105-4d40-91cd-cc207fa1e960 tempest-GroupSnapshotsTest-148616543 None] Update group completed successfully.
Apr 16 19:48:15 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-72572ed7-f93e-425f-9f45-bbbf8054d27c tempest-GroupSnapshotsTest-148616543 None] Update group completed successfully.
Apr 16 19:48:16 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] GroupSnapshot 9da737d8-350f-4db7-a6be-7744c7d4e356: creating.
Apr 16 19:48:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Group snapshot 9da737d8-350f-4db7-a6be-7744c7d4e356: creating. {{(pid=82616) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 16 19:48:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Creating offline snapshot 3da4d577-b5df-49cb-9dbe-2d56b5c53485 of volume 4fdd4301-35a4-4b67-84c4-57a7faa18f8f {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:48:17 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a78e91-2828-4efb-bb6e-5fbd9415f110]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:17 devstack sudo[84949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f
Apr 16 19:48:17 devstack sudo[84949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:17 devstack sudo[84949]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f" returned: 0 in 0.726s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:17 devstack sudo[84954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485 1G
Apr 16 19:48:17 devstack sudo[84954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:18 devstack sudo[84954]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485 1G" returned: 0 in 0.676s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:18 devstack sudo[84961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485
Apr 16 19:48:18 devstack sudo[84961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:19 devstack sudo[84961]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485" returned: 0 in 0.633s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:19 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485 is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:48:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:19 devstack sudo[84968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485
Apr 16 19:48:19 devstack sudo[84968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:19 devstack sudo[84968]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485" returned: 0 in 0.544s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:19 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=102,cinder:UPDATE=79,cinder:INSERT=23,cinder:DELETE=6 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:48:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:19 devstack sudo[84977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.info
Apr 16 19:48:19 devstack sudo[84977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:20 devstack sudo[84977]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.info" returned: 0 in 0.508s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:20 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:48:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:20 devstack sudo[84980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.info
Apr 16 19:48:20 devstack sudo[84980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:20 devstack sudo[84980]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.info" returned: 0 in 0.494s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.668s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Creating offline snapshot 5c563716-aa34-4214-b22d-ba40e6ad14ef of volume 59db9063-7cc6-46dd-bc40-0c8198ab8379 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:48:20 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e087378-06bb-4508-a498-12451fd647d8]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:20 devstack sudo[84983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379
Apr 16 19:48:20 devstack sudo[84983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=100,cinder:UPDATE=106,cinder:DELETE=5,cinder:INSERT=17 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Flow 'volume_create_manager' (45102d2e-bd5a-4db6-a603-f5bdac008c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535482a5-566d-47cb-9846-bf6a920cac09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:21 devstack sudo[84983]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379" returned: 0 in 0.748s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535482a5-566d-47cb-9846-bf6a920cac09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2012328252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1198ea71352e49fcb3f3e23ed9a60a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:21Z,use_quota=True,user_id='e291a0c95c9c44e08a686a804b0ccd7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:21 devstack sudo[85015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef 1G
Apr 16 19:48:21 devstack sudo[85015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583dc0c8-654e-461f-8c23-fa53f07f9283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583dc0c8-654e-461f-8c23-fa53f07f9283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0e8be3-2d58-4ba2-bfdc-609b144c9e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0e8be3-2d58-4ba2-bfdc-609b144c9e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f', 'volume_name': 'volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7c4c31-5579-4308-8e2a-dfb7843fd6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7c4c31-5579-4308-8e2a-dfb7843fd6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5385a1f7-41ad-408b-9d17-4c42f406706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:21 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Volume cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f', 'volume_size': 1}
Apr 16 19:48:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:22 devstack sudo[85015]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef 1G" returned: 0 in 0.856s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59db9063-7cc6-46dd-bc40-0c8198ab8379 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:22 devstack sudo[85022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59db9063-7cc6-46dd-bc40-0c8198ab8379 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef
Apr 16 19:48:22 devstack sudo[85022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:22 devstack sudo[85022]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59db9063-7cc6-46dd-bc40-0c8198ab8379 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef" returned: 0 in 0.647s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:22 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:48:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:23 devstack sudo[85028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef
Apr 16 19:48:23 devstack sudo[85028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:23 devstack sudo[85028]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef" returned: 0 in 0.622s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:23 devstack sudo[85032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.info
Apr 16 19:48:23 devstack sudo[85032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:24 devstack sudo[85032]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.info" returned: 0 in 0.538s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:24 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:24 devstack sudo[85035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.info
Apr 16 19:48:24 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:24 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.info" returned: 0 in 0.783s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.288s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.420s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2012328252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1198ea71352e49fcb3f3e23ed9a60a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:21Z,use_quota=True,user_id='e291a0c95c9c44e08a686a804b0ccd7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Creating volume cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:48:24 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:48:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:25 devstack sudo[85044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f 1073741824
Apr 16 19:48:25 devstack sudo[85044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:25 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1f2dbfc2-7b2a-401e-acaa-9a507c75e8a2 tempest-GroupSnapshotsTest-148616543 None] group_snapshot 9da737d8-350f-4db7-a6be-7744c7d4e356: created successfully
Apr 16 19:48:25 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] group_snapshot 9da737d8-350f-4db7-a6be-7744c7d4e356: deleting
Apr 16 19:48:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] group_snapshot 9da737d8-350f-4db7-a6be-7744c7d4e356: deleting {{(pid=82616) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 16 19:48:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-4fdd4301-35a4-4b67-84c4-57a7faa18f8f" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-4fdd4301-35a4-4b67-84c4-57a7faa18f8f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-3da4d577-b5df-49cb-9dbe-2d56b5c53485" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-3da4d577-b5df-49cb-9dbe-2d56b5c53485" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Deleting offline snapshot 3da4d577-b5df-49cb-9dbe-2d56b5c53485 of volume 4fdd4301-35a4-4b67-84c4-57a7faa18f8f {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:48:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] snapshot_file for this snap is: volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:48:25 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a29f225-3986-4907-bdf8-4d270216e0c5]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:25 devstack sudo[85067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485
Apr 16 19:48:25 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:25 devstack sudo[85044]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f 1073741824" returned: 0 in 0.938s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:26 devstack sudo[85069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f
Apr 16 19:48:26 devstack sudo[85069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:26 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485" returned: 0 in 0.615s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:48:26 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d828c295-e494-413f-bedd-db99ce3d4b8f]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:26 devstack sudo[85074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f
Apr 16 19:48:26 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:26 devstack sudo[85069]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f" returned: 0 in 0.592s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:48:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5385a1f7-41ad-408b-9d17-4c42f406706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded1efa6-194c-492b-a8c5-84fe2bd6c8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:26 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Volume volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f (cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f): created successfully
Apr 16 19:48:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded1efa6-194c-492b-a8c5-84fe2bd6c8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Flow 'volume_create_manager' (45102d2e-bd5a-4db6-a603-f5bdac008c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:48:26 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c4a0def3-c6ca-41c7-9e53-de3830fe0939 tempest-VolumesServicesTestJSON-56891024 None] Created volume successfully.
Apr 16 19:48:27 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f" returned: 0 in 0.632s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:27 devstack sudo[85080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485
Apr 16 19:48:27 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:27 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485" returned: 0 in 0.567s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:27 devstack sudo[85085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485
Apr 16 19:48:27 devstack sudo[85085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Acquiring lock "cinder-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Lock "cinder-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Acquiring lock "cinder-quobyte-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Lock "cinder-quobyte-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f" acquired by "delete_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a250a7-ae8d-40ea-bb9e-c5199482dcae]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:28 devstack sudo[85088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f
Apr 16 19:48:28 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:28 devstack sudo[85085]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f.3da4d577-b5df-49cb-9dbe-2d56b5c53485" returned: 0 in 0.545s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-3da4d577-b5df-49cb-9dbe-2d56b5c53485" released by "_delete_snapshot" :: held 2.438s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-4fdd4301-35a4-4b67-84c4-57a7faa18f8f" released by "delete_snapshot" :: held 2.463s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-59db9063-7cc6-46dd-bc40-0c8198ab8379" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-59db9063-7cc6-46dd-bc40-0c8198ab8379" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-5c563716-aa34-4214-b22d-ba40e6ad14ef" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-5c563716-aa34-4214-b22d-ba40e6ad14ef" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Deleting offline snapshot 5c563716-aa34-4214-b22d-ba40e6ad14ef of volume 59db9063-7cc6-46dd-bc40-0c8198ab8379 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] snapshot_file for this snap is: volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca591ff-ec93-44d2-b366-93487b18c9cb]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:28 devstack sudo[85090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef
Apr 16 19:48:28 devstack sudo[85090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:28 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f" returned: 0 in 0.629s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:28 devstack sudo[85098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f
Apr 16 19:48:28 devstack sudo[85098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:28 devstack sudo[85090]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef" returned: 0 in 0.588s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59db9063-7cc6-46dd-bc40-0c8198ab8379(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a38def-d173-49a2-867c-f58957810c3d]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:28 devstack sudo[85103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379
Apr 16 19:48:28 devstack sudo[85103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:29 devstack sudo[85098]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f" returned: 0 in 0.521s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Lock "cinder-quobyte-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f" released by "delete_volume" :: held 1.193s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:29 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Created reservations ['dd6f787f-867e-4afe-a381-8d5a934891c2', 'ebc9c6bf-a140-4eb6-8eaf-99b2910bc043', '68f83c81-e1e3-437a-91f8-e35b10cc8d56', '783eddb2-2353-4cc8-9324-688248477e92'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:48:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:48:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:48:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:29 devstack sudo[85109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:48:29 devstack sudo[85109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:29 devstack sudo[85103]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379" returned: 0 in 0.563s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:29 devstack sudo[85112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef
Apr 16 19:48:29 devstack sudo[85112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:30 devstack sudo[85109]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.686s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:30 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:48:30 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Deleted volume successfully.
Apr 16 19:48:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a50e2dc6-e2c0-44de-9bf2-014daadde9e6 tempest-VolumesServicesTestJSON-56891024 None] Lock "cinder-cc14ddc4-73d5-4001-aef5-38b4e6ef2b8f-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:30 devstack sudo[85112]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef" returned: 0 in 1.422s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:30 devstack sudo[85146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef
Apr 16 19:48:30 devstack sudo[85146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:31 devstack sudo[85146]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379.5c563716-aa34-4214-b22d-ba40e6ad14ef" returned: 0 in 0.988s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-5c563716-aa34-4214-b22d-ba40e6ad14ef" released by "_delete_snapshot" :: held 3.647s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-59db9063-7cc6-46dd-bc40-0c8198ab8379" released by "delete_snapshot" :: held 3.665s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:31 devstack cinder-volume[82616]: WARNING cinder.quota [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1308647448 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1308647448, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:48:31 devstack cinder-volume[82616]: WARNING cinder.quota [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1308647448 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1308647448, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:48:31 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Created reservations ['7e869bae-4100-4f20-9082-160bc1bc0889', '574e1f51-9815-4ca1-877e-73779036465e', '0c3e856f-6ab9-44e6-b401-683697c8810d', '1d11b201-ed4d-41d4-8bf6-eba9a3b23e10'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:48:32 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] Created reservations ['1cb6aca1-e1e6-40a4-8302-593da0fb3c0f', '3fd11c08-947b-4c12-9c32-507cd58f70fc', '732c678f-65b6-4b8c-a504-dff32a72320c', '3722a182-7e4d-430d-b79d-3c42ead54f1a'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:48:32 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-831e83ea-d69e-4939-b05b-f16159ca1162 tempest-GroupSnapshotsTest-148616543 None] group_snapshot 9da737d8-350f-4db7-a6be-7744c7d4e356: deleted successfully
Apr 16 19:48:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-4fdd4301-35a4-4b67-84c4-57a7faa18f8f" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-4fdd4301-35a4-4b67-84c4-57a7faa18f8f" acquired by "delete_volume" :: waited 0.029s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:33 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b977084-8331-47b4-b69f-8643485895a8]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:33 devstack sudo[85174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f
Apr 16 19:48:33 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:34 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f" returned: 0 in 0.981s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:34 devstack sudo[85180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f
Apr 16 19:48:34 devstack sudo[85180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:35 devstack sudo[85180]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4fdd4301-35a4-4b67-84c4-57a7faa18f8f" returned: 0 in 1.007s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-4fdd4301-35a4-4b67-84c4-57a7faa18f8f" released by "delete_volume" :: held 2.063s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-59db9063-7cc6-46dd-bc40-0c8198ab8379" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-59db9063-7cc6-46dd-bc40-0c8198ab8379" acquired by "delete_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:35 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef5d24e-84f3-4297-a4ee-333e670daf34]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:35 devstack sudo[85184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379
Apr 16 19:48:35 devstack sudo[85184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:36 devstack sudo[85184]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379" returned: 0 in 0.699s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:36 devstack sudo[85190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379
Apr 16 19:48:36 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:37 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59db9063-7cc6-46dd-bc40-0c8198ab8379" returned: 0 in 0.891s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-59db9063-7cc6-46dd-bc40-0c8198ab8379" released by "delete_volume" :: held 1.685s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:37 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Created reservations ['b1386c10-c223-4576-b6f1-56563e8e759e'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:48:37 devstack cinder-volume[82616]: WARNING cinder.quota [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1308647448 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1308647448, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:48:37 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Created reservations ['196f82f8-dc8e-4491-8f5a-e40cb1085ce1', '44ae7f84-7539-4c20-8ee4-94fbac379383', '5d0c622e-75f6-4da6-a0c7-95bbbb90efe9', '274fd87e-4e5e-4528-9dcd-33980d278b4c'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:48:37 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Created reservations ['cac346aa-f761-486c-acdd-6308cbe5010b', 'aa2d2fdc-4749-4276-865e-af9d8e0d0833', '71ae0446-c3c8-468e-91de-0b0e60d20c19', '293c66aa-282b-4ecb-92fd-ba7f3b58c72a'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:48:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:37 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:48:37 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:48:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:37 devstack sudo[85196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:48:37 devstack sudo[85196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:38 devstack sudo[85196]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.958s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:38 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:48:38 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0d6c8d13-7753-474a-b1f3-79309534a00f tempest-GroupSnapshotsTest-148616543 None] Delete group completed successfully.
Apr 16 19:48:39 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-bd726303-cc8c-4a8e-a9fa-6b1fee6606e4 tempest-GroupSnapshotsTest-148616543 None] Group tempest-GroupSnapshotsTest-Group-766899047: creating
Apr 16 19:48:39 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-bd726303-cc8c-4a8e-a9fa-6b1fee6606e4 tempest-GroupSnapshotsTest-148616543 None] Group tempest-GroupSnapshotsTest-Group-766899047: created successfully
Apr 16 19:48:39 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-bd726303-cc8c-4a8e-a9fa-6b1fee6606e4 tempest-GroupSnapshotsTest-148616543 None] Create group completed successfully.
Apr 16 19:48:40 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Flow 'volume_create_manager' (5a378e55-b0c7-4e16-a05d-6599b8de19e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6f7dce-2b6b-4628-8daf-3c90d689084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6f7dce-2b6b-4628-8daf-3c90d689084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1624140670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=168589b8-f28d-4092-8c3a-9fea968a760c,host='devstack@QuobyteHD#QuobyteHD',id=fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b74d79805c4836aeea811aeccb0aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:41Z,use_quota=True,user_id='e567c3713d3b4f3caa3392590df11703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c31942b4-1c3a-4253-9dfc-63cf150f7180),volume_type_id=c31942b4-1c3a-4253-9dfc-63cf150f7180)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2020ad-9f54-4910-b022-cc29b389f6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2020ad-9f54-4910-b022-cc29b389f6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4192cff-97ed-4505-81ad-970862f997f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4192cff-97ed-4505-81ad-970862f997f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553', 'volume_name': 'volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1988f1e-f42d-4217-9915-3879cd715bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1988f1e-f42d-4217-9915-3879cd715bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6bd71c-942d-44e6-bb51-b0c3a5369bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:41 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Volume fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553', 'volume_size': 1}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=168589b8-f28d-4092-8c3a-9fea968a760c,created_at=2026-04-16T17:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1624140670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=168589b8-f28d-4092-8c3a-9fea968a760c,host='devstack@QuobyteHD#QuobyteHD',id=fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b74d79805c4836aeea811aeccb0aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:41Z,use_quota=True,user_id='e567c3713d3b4f3caa3392590df11703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c31942b4-1c3a-4253-9dfc-63cf150f7180),volume_type_id=c31942b4-1c3a-4253-9dfc-63cf150f7180)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Creating volume fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:48:41 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:48:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:41 devstack sudo[85256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 1073741824
Apr 16 19:48:41 devstack sudo[85256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:42 devstack sudo[85256]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 1073741824" returned: 0 in 1.644s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:42 devstack sudo[85269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553
Apr 16 19:48:42 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:43 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553" returned: 0 in 1.089s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] <== create_volume: return (2811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:48:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.814s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6bd71c-942d-44e6-bb51-b0c3a5369bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555db844-ce9f-4ac5-8081-0996e6e4b772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:43 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Volume volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 (fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553): created successfully
Apr 16 19:48:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555db844-ce9f-4ac5-8081-0996e6e4b772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Flow 'volume_create_manager' (5a378e55-b0c7-4e16-a05d-6599b8de19e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:48:43 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-b35150be-47ba-4125-9148-718628ba7ee0 tempest-GroupSnapshotsTest-148616543 None] Created volume successfully.
Apr 16 19:48:44 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] GroupSnapshot 348327bd-c168-4a70-9b30-6141e11f1494: creating.
Apr 16 19:48:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] Group snapshot 348327bd-c168-4a70-9b30-6141e11f1494: creating. {{(pid=82616) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 16 19:48:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] Creating offline snapshot 2aff8fca-6ac0-42f4-b8ab-fe52925ce96d of volume fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:48:44 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c60eeea-9d71-4dc4-841c-5dcb20e5d5a5]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:44 devstack sudo[85297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553
Apr 16 19:48:44 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:45 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553" returned: 0 in 0.987s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:45 devstack sudo[85303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d 1G
Apr 16 19:48:45 devstack sudo[85303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:46 devstack sudo[85303]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d 1G" returned: 0 in 1.024s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:46 devstack sudo[85314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d
Apr 16 19:48:46 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:47 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d" returned: 0 in 0.669s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:47 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:48:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:47 devstack sudo[85341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d
Apr 16 19:48:47 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:48 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d" returned: 0 in 0.570s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:48 devstack sudo[85351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.info
Apr 16 19:48:48 devstack sudo[85351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:48 devstack sudo[85351]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.info" returned: 0 in 0.775s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:48 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:48:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:48 devstack sudo[85354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.info
Apr 16 19:48:48 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Flow 'volume_create_manager' (2ba72460-31c8-4524-810e-7ff94d612cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafa5b93-c5f3-4c01-a929-a16c7430049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafa5b93-c5f3-4c01-a929-a16c7430049e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1918532177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a548b433-e50b-4209-85ad-80eea72771ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88020c23366f489392fe518fe3552501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:49Z,use_quota=True,user_id='0d1f01a65c084e34a6fbdaaa891d3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd69e1ea-48cb-4f47-8474-9c7cbeaa293f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd69e1ea-48cb-4f47-8474-9c7cbeaa293f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2782d891-0015-4ca8-aa4e-d3437f3080c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2782d891-0015-4ca8-aa4e-d3437f3080c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a548b433-e50b-4209-85ad-80eea72771ce', 'volume_name': 'volume-a548b433-e50b-4209-85ad-80eea72771ce', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458e2eee-dc50-49cf-a0f1-3df183be2c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458e2eee-dc50-49cf-a0f1-3df183be2c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad205ee-103b-4063-9d0f-afa326442ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:49 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Volume a548b433-e50b-4209-85ad-80eea72771ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a548b433-e50b-4209-85ad-80eea72771ce', 'volume_size': 1}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:49 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.info" returned: 0 in 0.826s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.969s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.219s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1918532177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a548b433-e50b-4209-85ad-80eea72771ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88020c23366f489392fe518fe3552501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:49Z,use_quota=True,user_id='0d1f01a65c084e34a6fbdaaa891d3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Creating volume a548b433-e50b-4209-85ad-80eea72771ce {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:48:49 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:48:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a548b433-e50b-4209-85ad-80eea72771ce 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:49 devstack sudo[85357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a548b433-e50b-4209-85ad-80eea72771ce 1073741824
Apr 16 19:48:49 devstack sudo[85357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:49 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-dafa8082-e31a-4afa-8896-36350dba5ef9 tempest-GroupSnapshotsTest-148616543 None] group_snapshot 348327bd-c168-4a70-9b30-6141e11f1494: created successfully
Apr 16 19:48:50 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] group_snapshot 348327bd-c168-4a70-9b30-6141e11f1494: deleting
Apr 16 19:48:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] group_snapshot 348327bd-c168-4a70-9b30-6141e11f1494: deleting {{(pid=82616) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 16 19:48:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-2aff8fca-6ac0-42f4-b8ab-fe52925ce96d" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-2aff8fca-6ac0-42f4-b8ab-fe52925ce96d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Deleting offline snapshot 2aff8fca-6ac0-42f4-b8ab-fe52925ce96d of volume fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:48:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] snapshot_file for this snap is: volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:48:50 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbeccf2-6ae7-41e2-bec0-c472bddcdf10]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:50 devstack sudo[85362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d
Apr 16 19:48:50 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:50 devstack sudo[85357]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a548b433-e50b-4209-85ad-80eea72771ce 1073741824" returned: 0 in 1.114s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a548b433-e50b-4209-85ad-80eea72771ce {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:51 devstack sudo[85364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a548b433-e50b-4209-85ad-80eea72771ce
Apr 16 19:48:51 devstack sudo[85364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:51 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d" returned: 0 in 1.023s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:48:51 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe59f7b-2c26-4eff-9f71-98e5ed80a0a5]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:51 devstack sudo[85369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553
Apr 16 19:48:51 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:52 devstack sudo[85364]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a548b433-e50b-4209-85ad-80eea72771ce" returned: 0 in 1.334s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] <== create_volume: return (2523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:48:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.528s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad205ee-103b-4063-9d0f-afa326442ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a548b433-e50b-4209-85ad-80eea72771ce', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1545089b-0990-4a57-92f0-62e46eda9f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:52 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Volume volume-a548b433-e50b-4209-85ad-80eea72771ce (a548b433-e50b-4209-85ad-80eea72771ce): created successfully
Apr 16 19:48:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1545089b-0990-4a57-92f0-62e46eda9f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Flow 'volume_create_manager' (2ba72460-31c8-4524-810e-7ff94d612cce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:48:52 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-fbbbcf55-c2be-4692-a1bb-6f383825db65 tempest-ServersNegativeTestJSON-570162100 None] Created volume successfully.
Apr 16 19:48:53 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553" returned: 0 in 1.597s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:53 devstack sudo[85376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d
Apr 16 19:48:53 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:53 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:48:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Flow 'volume_create_manager' (309e1dc2-f8b4-4675-aadc-c6a07737e8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:48:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73fded2-32b9-400d-92db-caad6e667d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73fded2-32b9-400d-92db-caad6e667d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:48:53Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4653e4-3905-4a7a-b416-659d25279da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9114946bee2a4b44ae35f332d8c5b6d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:54Z,use_quota=True,user_id='23efb2cb268d4fe5adbd023282be05ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec85b52-5d92-4192-a30b-d7297a09dbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec85b52-5d92-4192-a30b-d7297a09dbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6633e92-abba-483b-abc3-1eb06504e45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:53 devstack cinder-volume[82616]: DEBUG cinder.image.glance [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Creating Keystone auth plugin from conf {{(pid=82616) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 16 19:48:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6633e92-abba-483b-abc3-1eb06504e45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a4653e4-3905-4a7a-b416-659d25279da5', 'volume_name': 'volume-9a4653e4-3905-4a7a-b416-659d25279da5', 'volume_size': 1, 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94595a210065472391c483fcf54511ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'created_at': datetime.datetime(2026, 4, 16, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa362aebe80>}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576e194e-5497-4da3-98d4-8e45a8c77fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576e194e-5497-4da3-98d4-8e45a8c77fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88a5e8e-9464-4321-a702-cef2b9602c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:54 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Volume 9a4653e4-3905-4a7a-b416-659d25279da5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a4653e4-3905-4a7a-b416-659d25279da5', 'volume_size': 1, 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94595a210065472391c483fcf54511ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'created_at': datetime.datetime(2026, 4, 16, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa362aebe80>}
Apr 16 19:48:54 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Trying to clone 9a4653e4-3905-4a7a-b416-659d25279da5 from image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]). {{(pid=82616) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 16 19:48:54 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d" returned: 0 in 1.694s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:54 devstack sudo[85405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d
Apr 16 19:48:54 devstack sudo[85405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:54 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82616) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 16 19:48:54 devstack cinder-volume[82616]: INFO cinder.image.image_utils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Image download 20.69 MB at 20.69 MB/s
Apr 16 19:48:54 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[beac9607-78ee-42b6-881f-c5264ec488e8]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:55 devstack sudo[85407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD
Apr 16 19:48:55 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:56 devstack sudo[85405]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553.2aff8fca-6ac0-42f4-b8ab-fe52925ce96d" returned: 0 in 1.238s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-2aff8fca-6ac0-42f4-b8ab-fe52925ce96d" released by "_delete_snapshot" :: held 5.673s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553" released by "delete_snapshot" :: held 5.687s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:48:56 devstack cinder-volume[82616]: WARNING cinder.quota [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-662971672 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-662971672, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:48:56 devstack cinder-volume[82616]: WARNING cinder.quota [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-662971672 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-662971672, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] Created reservations ['31c6ed7b-4dee-4f0b-933f-ab88530858bf', 'e8146969-fa69-4a51-9422-7e99b494e8d8', '4368691a-eafe-436d-9cf3-86ce395791ec', '9fbca9ca-b2ea-4505-a892-4e055a8bbb1f'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:48:56 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-92509e90-1184-440f-87de-64b0ec3f3fe4 tempest-GroupSnapshotsTest-148616543 None] group_snapshot 348327bd-c168-4a70-9b30-6141e11f1494: deleted successfully
Apr 16 19:48:56 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD" returned: 0 in 1.556s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Temporary image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e is fetched for user 23efb2cb268d4fe5adbd023282be05ff. {{(pid=82616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c045e6-2b4d-4b7b-9850-74b5de0ccad7]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:48:56 devstack sudo[85414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD
Apr 16 19:48:56 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Flow 'volume_create_manager' (598ca8be-6553-48be-bb83-610ed7e17b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44c34c1-1d8b-4b46-8b84-be6a7ae1ba39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44c34c1-1d8b-4b46-8b84-be6a7ae1ba39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-936574134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0f2196-cf5b-49d3-a627-8c8671cc4d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88020c23366f489392fe518fe3552501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:57Z,use_quota=True,user_id='0d1f01a65c084e34a6fbdaaa891d3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109921f0-10ac-425b-a9c1-5f939079f247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109921f0-10ac-425b-a9c1-5f939079f247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c74ae41-16d3-4b5e-8811-b78a162f11f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c74ae41-16d3-4b5e-8811-b78a162f11f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b0f2196-cf5b-49d3-a627-8c8671cc4d8c', 'volume_name': 'volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6272eb-0dd6-4a15-94ea-c88bf62a9849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6272eb-0dd6-4a15-94ea-c88bf62a9849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7400a5-eeb5-4eec-ad84-2bd3bcb7512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:48:57 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Volume 5b0f2196-cf5b-49d3-a627-8c8671cc4d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c', 'volume_size': 1}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-936574134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0f2196-cf5b-49d3-a627-8c8671cc4d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88020c23366f489392fe518fe3552501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:57Z,use_quota=True,user_id='0d1f01a65c084e34a6fbdaaa891d3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Creating volume 5b0f2196-cf5b-49d3-a627-8c8671cc4d8c {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:48:57 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:57 devstack sudo[85416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c 1073741824
Apr 16 19:48:57 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:57 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD" returned: 0 in 0.992s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "cinder-quobyte-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553" acquired by "delete_volume" :: waited 0.029s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1514dad0-05a8-42cc-8fd6-83c29b431cad]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:48:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:58 devstack sudo[85428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553
Apr 16 19:48:58 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:59 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553" returned: 0 in 1.127s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:59 devstack sudo[85439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553
Apr 16 19:48:59 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:59 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c 1073741824" returned: 0 in 2.195s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:48:59 devstack sudo[85465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c
Apr 16 19:48:59 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:48:59 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root
Apr 16 19:48:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553" returned: 0 in 0.803s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:48:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Lock "cinder-quobyte-fdf5c0ce-fb8f-47cd-a6e8-8a7a540da553" released by "delete_volume" :: held 2.223s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Created reservations ['e74ef8dc-00c2-4a16-953b-59dbb79f9e76'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:00 devstack cinder-volume[82616]: WARNING cinder.quota [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-662971672 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-662971672, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Created reservations ['c5824e8f-b5f2-4898-9aff-4a7054dd7fd7', '34c147e9-2dbb-4f15-89a6-be37d1acb4cf', 'ddcff3a0-0ed5-4624-91cd-194bbb6ec0d9', '68a8cb18-29be-48b8-b17b-1af36a2cb3d7'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:00 devstack sudo[85469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:00 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:00 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c" returned: 0 in 1.099s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] <== create_volume: return (3382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.397s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.782s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:48:53Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4653e4-3905-4a7a-b416-659d25279da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9114946bee2a4b44ae35f332d8c5b6d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:54Z,use_quota=True,user_id='23efb2cb268d4fe5adbd023282be05ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Creating volume 9a4653e4-3905-4a7a-b416-659d25279da5 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:49:00 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7400a5-eeb5-4eec-ad84-2bd3bcb7512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5ef6c4-4385-46cd-8545-687dfe3362b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:00 devstack sudo[85471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 1073741824
Apr 16 19:49:00 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:00 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Volume volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c (5b0f2196-cf5b-49d3-a627-8c8671cc4d8c): created successfully
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5ef6c4-4385-46cd-8545-687dfe3362b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Flow 'volume_create_manager' (598ca8be-6553-48be-bb83-610ed7e17b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:00 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-d7c774b9-735a-4f63-8094-b6a05057cf53 tempest-ServersNegativeTestJSON-570162100 None] Created volume successfully.
Apr 16 19:49:01 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.634s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:01 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:01 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-fb4ef2b6-b7fc-4660-abdd-b757fb058a8f tempest-GroupSnapshotsTest-148616543 None] Delete group completed successfully.
Apr 16 19:49:01 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 1073741824" returned: 0 in 1.244s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:01 devstack sudo[85511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5
Apr 16 19:49:01 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Acquiring lock "cinder-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Lock "cinder-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Acquiring lock "cinder-quobyte-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Lock "cinder-quobyte-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:02 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd9be36-3213-41c2-9bdc-ea2bcf368194]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:02 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5" returned: 0 in 0.788s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:49:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:02 devstack cinder-volume[82616]: DEBUG cinder.volume.volume_utils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Attempting download of ab1fba02-b27f-4200-aae8-7c2e7a56bc6e ((None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}])) to volume 9a4653e4-3905-4a7a-b416-659d25279da5. {{(pid=82616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 16 19:49:02 devstack sudo[85514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c
Apr 16 19:49:02 devstack sudo[85514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:02 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ca70cf-3ee3-463c-a82f-522e4c56b68b]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_c0rrs99g {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:02 devstack sudo[85516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_c0rrs99g
Apr 16 19:49:02 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:03 devstack sudo[85514]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c" returned: 0 in 0.919s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:03 devstack sudo[85521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c
Apr 16 19:49:03 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:03 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_c0rrs99g" returned: 0 in 1.024s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_c0rrs99g {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:03 devstack sudo[85525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_c0rrs99g
Apr 16 19:49:03 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:04 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c" returned: 0 in 0.763s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Lock "cinder-quobyte-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c" released by "delete_volume" :: held 1.769s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Created reservations ['a631381b-6592-449a-8a1c-91f7a781bd25', '35546888-bf1c-4c67-ae92-ffcc1e27a959', '3706cc20-98b9-4187-8a4f-5b193896ed85', 'e568c1d3-9ee9-4ac0-8067-e2a6311f85e2'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:04 devstack sudo[85528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:04 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:04 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_c0rrs99g" returned: 1 in 0.743s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_c0rrs99g' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3da2b4-2b42-4462-82cb-1b6a75db3179]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:04 devstack sudo[85532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD
Apr 16 19:49:04 devstack sudo[85532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Acquiring lock "cinder-a548b433-e50b-4209-85ad-80eea72771ce-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Lock "cinder-a548b433-e50b-4209-85ad-80eea72771ce-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Acquiring lock "cinder-quobyte-a548b433-e50b-4209-85ad-80eea72771ce" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Lock "cinder-quobyte-a548b433-e50b-4209-85ad-80eea72771ce" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[51afccca-d826-445c-b635-9382d734cf3c]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a548b433-e50b-4209-85ad-80eea72771ce {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:04 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.533s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:04 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Deleted volume successfully.
Apr 16 19:49:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c6b0688c-2b27-4ae3-8e9b-2c3424bad3ef tempest-ServersNegativeTestJSON-570162100 None] Lock "cinder-5b0f2196-cf5b-49d3-a627-8c8671cc4d8c-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:04 devstack sudo[85536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a548b433-e50b-4209-85ad-80eea72771ce
Apr 16 19:49:04 devstack sudo[85536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:05 devstack sudo[85532]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:05 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] ab1fba02-b27f-4200-aae8-7c2e7a56bc6e was qcow2, converting to raw {{(pid=82616) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 16 19:49:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:05 devstack sudo[85541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5
Apr 16 19:49:05 devstack sudo[85541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:05 devstack sudo[85536]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a548b433-e50b-4209-85ad-80eea72771ce" returned: 0 in 1.023s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a548b433-e50b-4209-85ad-80eea72771ce {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:05 devstack sudo[85546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a548b433-e50b-4209-85ad-80eea72771ce
Apr 16 19:49:05 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:06 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a548b433-e50b-4209-85ad-80eea72771ce" returned: 0 in 0.674s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Lock "cinder-quobyte-a548b433-e50b-4209-85ad-80eea72771ce" released by "delete_volume" :: held 1.809s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:06 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Created reservations ['2fdf10c9-0404-460d-98e2-a3417aa46833', 'bbc6fe8a-0229-446a-b56a-a5b57c46d94b', '9e6c2ae0-be9b-4890-9cf4-ca0b25c84765', 'a61cc5ef-1b0b-410d-bc3d-fcb8131d3ea2'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:06 devstack sudo[85561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:06 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:07 devstack sudo[85541]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5" returned: 0 in 1.817s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:07 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_8shvpr6mdevstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:49:07 devstack cinder-volume[82616]: INFO cinder.image.image_utils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Converted 112.00 MB image at 61.58 MB/s
Apr 16 19:49:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:07 devstack sudo[85563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 1G
Apr 16 19:49:07 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:07 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.954s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:07 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:07 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Deleted volume successfully.
Apr 16 19:49:07 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9ea1cf6c-7e8c-4041-bb05-776fbe3397b6 tempest-ServersNegativeTestJSON-570162100 None] Lock "cinder-a548b433-e50b-4209-85ad-80eea72771ce-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:07 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 1G" returned: 0 in 0.731s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:07 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a100c4-2c65-41ba-ad79-693f58450573]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:07 devstack sudo[85572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5
Apr 16 19:49:07 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:08 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5" returned: 0 in 0.780s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:08 devstack sudo[85601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5
Apr 16 19:49:08 devstack sudo[85601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:09 devstack sudo[85601]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5" returned: 1 in 1.200s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:49:09 devstack cinder-volume[82616]: DEBUG cinder.volume.volume_utils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Downloaded image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e ((None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}])) to volume 9a4653e4-3905-4a7a-b416-659d25279da5 successfully. {{(pid=82616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 16 19:49:09 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Temporary image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e for user 23efb2cb268d4fe5adbd023282be05ff is deleted. {{(pid=82616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 16 19:49:09 devstack cinder-volume[82616]: DEBUG cinder.volume.volume_utils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Marking volume 9a4653e4-3905-4a7a-b416-659d25279da5 as bootable. {{(pid=82616) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 16 19:49:09 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Copying metadata from image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e to 9a4653e4-3905-4a7a-b416-659d25279da5. {{(pid=82616) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 16 19:49:09 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Creating volume glance metadata for volume 9a4653e4-3905-4a7a-b416-659d25279da5 backed by image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82616) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 16 19:49:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88a5e8e-9464-4321-a702-cef2b9602c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a4653e4-3905-4a7a-b416-659d25279da5', 'volume_size': 1, 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94595a210065472391c483fcf54511ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'created_at': datetime.datetime(2026, 4, 16, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa362aebe80>}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ce3688-936d-477d-b6a6-29e252ac425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:09 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Volume volume-9a4653e4-3905-4a7a-b416-659d25279da5 (9a4653e4-3905-4a7a-b416-659d25279da5): created successfully
Apr 16 19:49:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ce3688-936d-477d-b6a6-29e252ac425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Flow 'volume_create_manager' (309e1dc2-f8b4-4675-aadc-c6a07737e8b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:09 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-bec460a6-fce9-44e0-9c79-266f72f0f9d0 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Created volume successfully.
Apr 16 19:49:11 devstack cinder-volume[82616]: DEBUG oslo_service.periodic_task [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82616) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 19:49:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:11 devstack sudo[85612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:11 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:12 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.529s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:12 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-f0a4f5fc-6256-4f4a-8a8f-e2e07d876652 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-f0a4f5fc-6256-4f4a-8a8f-e2e07d876652 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:12 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9c0fad-f33c-4134-86c5-dd62bf305d1f]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-f0a4f5fc-6256-4f4a-8a8f-e2e07d876652 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:12 devstack sudo[85623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5
Apr 16 19:49:12 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:13 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-be2853d8-2fa1-4200-919e-b25aa9bbbc87 tempest-GroupsTest-386831391 None] Group tempest-Group1-375653245: creating
Apr 16 19:49:13 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-be2853d8-2fa1-4200-919e-b25aa9bbbc87 tempest-GroupsTest-386831391 None] Group tempest-Group1-375653245: created successfully
Apr 16 19:49:13 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-be2853d8-2fa1-4200-919e-b25aa9bbbc87 tempest-GroupsTest-386831391 None] Create group completed successfully.
Apr 16 19:49:13 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-f0a4f5fc-6256-4f4a-8a8f-e2e07d876652 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5" returned: 0 in 0.659s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-f0a4f5fc-6256-4f4a-8a8f-e2e07d876652 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:13 devstack sudo[85627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5
Apr 16 19:49:13 devstack sudo[85627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:13 devstack sudo[85627]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-f0a4f5fc-6256-4f4a-8a8f-e2e07d876652 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5" returned: 1 in 0.631s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-f0a4f5fc-6256-4f4a-8a8f-e2e07d876652 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:49:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-f0a4f5fc-6256-4f4a-8a8f-e2e07d876652 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.331s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-f0a4f5fc-6256-4f4a-8a8f-e2e07d876652 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de', 'name': 'volume-9a4653e4-3905-4a7a-b416-659d25279da5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b573f087-5a46-42e7-a806-7646c6a9c49f', 'enforce_multipath': True} {{(pid=82616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 16 19:49:14 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-dc8dea17-93c0-4eab-b12a-1298e88b396d req-f0a4f5fc-6256-4f4a-8a8f-e2e07d876652 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] attachment_update completed successfully.
Apr 16 19:49:14 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-bac1bfca-02b5-48c9-bce9-bdb7e0d58173 tempest-GroupsTest-386831391 None] Group tempest-Group2-678130140: creating
Apr 16 19:49:14 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-bac1bfca-02b5-48c9-bce9-bdb7e0d58173 tempest-GroupsTest-386831391 None] Group tempest-Group2-678130140: created successfully
Apr 16 19:49:14 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-bac1bfca-02b5-48c9-bce9-bdb7e0d58173 tempest-GroupsTest-386831391 None] Create group completed successfully.
Apr 16 19:49:15 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:49:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Flow 'volume_create_manager' (586ee1cb-405c-4718-968b-8bd883f6259a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166dea68-9a3d-4897-80b2-b74366eae933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166dea68-9a3d-4897-80b2-b74366eae933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1680787451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=83f74d7d-5b4d-4aee-a104-51c513149b11,host='devstack@QuobyteHD#QuobyteHD',id=646d92a2-3380-4a87-8849-766206239cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598c06c19bcc4daa9424f1c471f29070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:16Z,use_quota=True,user_id='74233dc3dcd1427b91ae2fb67c4c641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcc3052-ce91-46f3-974d-b04cfd6be3c8),volume_type_id=edcc3052-ce91-46f3-974d-b04cfd6be3c8)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9ecd8f-7507-4adc-915c-3bce951699c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9ecd8f-7507-4adc-915c-3bce951699c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227d3d87-d875-43fa-b733-f0f6b198c76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227d3d87-d875-43fa-b733-f0f6b198c76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646d92a2-3380-4a87-8849-766206239cba', 'volume_name': 'volume-646d92a2-3380-4a87-8849-766206239cba', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd360dc6-843d-4790-974b-019683521b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd360dc6-843d-4790-974b-019683521b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172d2519-e934-4795-9723-e787905b7f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:16 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Volume 646d92a2-3380-4a87-8849-766206239cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646d92a2-3380-4a87-8849-766206239cba', 'volume_size': 1}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=83f74d7d-5b4d-4aee-a104-51c513149b11,created_at=2026-04-16T17:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1680787451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=83f74d7d-5b4d-4aee-a104-51c513149b11,host='devstack@QuobyteHD#QuobyteHD',id=646d92a2-3380-4a87-8849-766206239cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598c06c19bcc4daa9424f1c471f29070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:16Z,use_quota=True,user_id='74233dc3dcd1427b91ae2fb67c4c641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcc3052-ce91-46f3-974d-b04cfd6be3c8),volume_type_id=edcc3052-ce91-46f3-974d-b04cfd6be3c8)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Creating volume 646d92a2-3380-4a87-8849-766206239cba {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:49:16 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-646d92a2-3380-4a87-8849-766206239cba 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:16 devstack sudo[85641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-646d92a2-3380-4a87-8849-766206239cba 1073741824
Apr 16 19:49:16 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:16 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-646d92a2-3380-4a87-8849-766206239cba 1073741824" returned: 0 in 0.632s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-646d92a2-3380-4a87-8849-766206239cba {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:16 devstack sudo[85647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-646d92a2-3380-4a87-8849-766206239cba
Apr 16 19:49:16 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:17 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-646d92a2-3380-4a87-8849-766206239cba" returned: 0 in 0.515s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:49:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172d2519-e934-4795-9723-e787905b7f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646d92a2-3380-4a87-8849-766206239cba', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba8645e-a6e6-4063-bdfb-ed0ab964dc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:17 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Volume volume-646d92a2-3380-4a87-8849-766206239cba (646d92a2-3380-4a87-8849-766206239cba): created successfully
Apr 16 19:49:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba8645e-a6e6-4063-bdfb-ed0ab964dc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Flow 'volume_create_manager' (586ee1cb-405c-4718-968b-8bd883f6259a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:17 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-5fd33b03-51cb-47eb-b79a-a891639f2daf tempest-GroupsTest-386831391 None] Created volume successfully.
Apr 16 19:49:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Acquiring lock "cinder-quobyte-646d92a2-3380-4a87-8849-766206239cba" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Lock "cinder-quobyte-646d92a2-3380-4a87-8849-766206239cba" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:18 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[be30e902-9903-4811-bdc5-e4c9c304d42b]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-646d92a2-3380-4a87-8849-766206239cba {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:18 devstack sudo[85674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-646d92a2-3380-4a87-8849-766206239cba
Apr 16 19:49:18 devstack sudo[85674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:19 devstack sudo[85674]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-646d92a2-3380-4a87-8849-766206239cba" returned: 0 in 0.567s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-646d92a2-3380-4a87-8849-766206239cba {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:19 devstack sudo[85680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-646d92a2-3380-4a87-8849-766206239cba
Apr 16 19:49:19 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:19 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-646d92a2-3380-4a87-8849-766206239cba" returned: 0 in 0.617s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:19 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Lock "cinder-quobyte-646d92a2-3380-4a87-8849-766206239cba" released by "delete_volume" :: held 1.230s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:19 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=92,cinder:UPDATE=109,cinder:INSERT=27,cinder:DELETE=5 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:49:19 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Created reservations ['e0e186b9-f7da-478e-bc8c-8e9c8a158470'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:19 devstack cinder-volume[82616]: WARNING cinder.quota [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-197274716 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-197274716, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:49:19 devstack cinder-volume[82616]: WARNING cinder.quota [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-197274716 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-197274716, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:49:19 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Created reservations ['ef1fc3c5-67fe-48ad-9e7d-86d25d448e4e', '5a2fced3-e93e-46ce-b0df-9610e226b267', '31153e11-66c4-4124-bb55-a38c0098ed71', '815c4348-6cd7-4f16-9ba4-2681facc5f64'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:19 devstack sudo[85683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:19 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:20 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.667s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:20 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:20 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-8e815a76-a8f7-4029-a2b0-0dd19757edc9 tempest-GroupsTest-386831391 None] Delete group completed successfully.
Apr 16 19:49:20 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-1da36126-a260-4ee0-a84b-fc270076909d tempest-GroupsTest-386831391 None] Created reservations ['efa97480-ab82-48d9-b029-56ddc203c133'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1da36126-a260-4ee0-a84b-fc270076909d tempest-GroupsTest-386831391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1da36126-a260-4ee0-a84b-fc270076909d tempest-GroupsTest-386831391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1da36126-a260-4ee0-a84b-fc270076909d tempest-GroupsTest-386831391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1da36126-a260-4ee0-a84b-fc270076909d tempest-GroupsTest-386831391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1da36126-a260-4ee0-a84b-fc270076909d tempest-GroupsTest-386831391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1da36126-a260-4ee0-a84b-fc270076909d tempest-GroupsTest-386831391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:21 devstack sudo[85702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:21 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=121,cinder:UPDATE=107,cinder:INSERT=38,cinder:DELETE=4 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Flow 'volume_create_manager' (a94de111-9276-4adb-8d19-01247fe72f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4f3559-6ceb-4a33-93f6-2d0db2c915cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4f3559-6ceb-4a33-93f6-2d0db2c915cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-623682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bfb7e3-b42f-4496-a1f9-df60153828d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a5ffa8615714dc9bb45cc2a1f0c9d88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:21Z,use_quota=True,user_id='1cc11a3299a84763a789ec232ac28af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549cd199-a3ab-4c30-af20-a261a87f119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549cd199-a3ab-4c30-af20-a261a87f119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae97cf2-a75d-4688-97ad-4b8a3c00d6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae97cf2-a75d-4688-97ad-4b8a3c00d6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21bfb7e3-b42f-4496-a1f9-df60153828d7', 'volume_name': 'volume-21bfb7e3-b42f-4496-a1f9-df60153828d7', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcaeafa7-3c43-4624-871c-4ac8ee71fe88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcaeafa7-3c43-4624-871c-4ac8ee71fe88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2c1f03-a1da-40e1-adef-add286269e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:21 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Volume 21bfb7e3-b42f-4496-a1f9-df60153828d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21bfb7e3-b42f-4496-a1f9-df60153828d7', 'volume_size': 1}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-623682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bfb7e3-b42f-4496-a1f9-df60153828d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a5ffa8615714dc9bb45cc2a1f0c9d88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:21Z,use_quota=True,user_id='1cc11a3299a84763a789ec232ac28af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Creating volume 21bfb7e3-b42f-4496-a1f9-df60153828d7 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:49:21 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21bfb7e3-b42f-4496-a1f9-df60153828d7 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:21 devstack sudo[85706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21bfb7e3-b42f-4496-a1f9-df60153828d7 1073741824
Apr 16 19:49:21 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:21 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1da36126-a260-4ee0-a84b-fc270076909d tempest-GroupsTest-386831391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.919s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:21 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-1da36126-a260-4ee0-a84b-fc270076909d tempest-GroupsTest-386831391 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:21 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1da36126-a260-4ee0-a84b-fc270076909d tempest-GroupsTest-386831391 None] Delete group completed successfully.
Apr 16 19:49:22 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-b73bba7f-6d14-4039-bda3-fbe96720929b tempest-GroupsTest-386831391 None] Group tempest-GroupsTest-Group-92981444: creating
Apr 16 19:49:22 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-b73bba7f-6d14-4039-bda3-fbe96720929b tempest-GroupsTest-386831391 None] Group tempest-GroupsTest-Group-92981444: created successfully
Apr 16 19:49:22 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-b73bba7f-6d14-4039-bda3-fbe96720929b tempest-GroupsTest-386831391 None] Create group completed successfully.
Apr 16 19:49:23 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21bfb7e3-b42f-4496-a1f9-df60153828d7 1073741824" returned: 0 in 1.410s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21bfb7e3-b42f-4496-a1f9-df60153828d7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:23 devstack sudo[85729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21bfb7e3-b42f-4496-a1f9-df60153828d7
Apr 16 19:49:23 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:23 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21bfb7e3-b42f-4496-a1f9-df60153828d7" returned: 0 in 0.571s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:49:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2c1f03-a1da-40e1-adef-add286269e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21bfb7e3-b42f-4496-a1f9-df60153828d7', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c23afe-c6c5-4e4c-97d1-f7ba079019b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:23 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Volume volume-21bfb7e3-b42f-4496-a1f9-df60153828d7 (21bfb7e3-b42f-4496-a1f9-df60153828d7): created successfully
Apr 16 19:49:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c23afe-c6c5-4e4c-97d1-f7ba079019b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Flow 'volume_create_manager' (a94de111-9276-4adb-8d19-01247fe72f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:23 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-53707787-ce41-4c4b-a308-2bf6346a386d req-78f09a1b-dda5-40fc-8c96-11bcd2c75eba tempest-VolumesGetTestJSON-1107098147 None] Created volume successfully.
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Acquiring lock "cinder-21bfb7e3-b42f-4496-a1f9-df60153828d7-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Lock "cinder-21bfb7e3-b42f-4496-a1f9-df60153828d7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Acquiring lock "cinder-quobyte-21bfb7e3-b42f-4496-a1f9-df60153828d7" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Lock "cinder-quobyte-21bfb7e3-b42f-4496-a1f9-df60153828d7" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[294035c7-3cc5-4fcb-bf4c-205eaf1a24ff]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21bfb7e3-b42f-4496-a1f9-df60153828d7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:24 devstack sudo[85734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21bfb7e3-b42f-4496-a1f9-df60153828d7
Apr 16 19:49:24 devstack sudo[85734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Flow 'volume_create_manager' (b4cc2674-a1bc-438a-8734-ad809a42a88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbca0c3d-3d36-4c6f-900a-d87efc9b59a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbca0c3d-3d36-4c6f-900a-d87efc9b59a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1844193487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e21e0bc2-5b3d-4115-a8db-ae7c955ee93e,host='devstack@QuobyteHD#QuobyteHD',id=bd9aeb33-cdd9-462a-a00e-3ac481f717d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598c06c19bcc4daa9424f1c471f29070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:24Z,use_quota=True,user_id='74233dc3dcd1427b91ae2fb67c4c641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a8a4e4d-a1c2-41eb-92a2-9a057c70b2df),volume_type_id=2a8a4e4d-a1c2-41eb-92a2-9a057c70b2df)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfb07a5-4fd0-476d-b75b-d38dd4d178d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfb07a5-4fd0-476d-b75b-d38dd4d178d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43582a1-5fdc-4e24-8292-8d1970ec03f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43582a1-5fdc-4e24-8292-8d1970ec03f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9aeb33-cdd9-462a-a00e-3ac481f717d7', 'volume_name': 'volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904a1330-0294-4b9f-b277-11df9dbfb0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904a1330-0294-4b9f-b277-11df9dbfb0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f7e9a6-0017-4e9c-ac39-852433ac19d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:24 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Volume bd9aeb33-cdd9-462a-a00e-3ac481f717d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7', 'volume_size': 1}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e21e0bc2-5b3d-4115-a8db-ae7c955ee93e,created_at=2026-04-16T17:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1844193487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e21e0bc2-5b3d-4115-a8db-ae7c955ee93e,host='devstack@QuobyteHD#QuobyteHD',id=bd9aeb33-cdd9-462a-a00e-3ac481f717d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598c06c19bcc4daa9424f1c471f29070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:24Z,use_quota=True,user_id='74233dc3dcd1427b91ae2fb67c4c641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a8a4e4d-a1c2-41eb-92a2-9a057c70b2df),volume_type_id=2a8a4e4d-a1c2-41eb-92a2-9a057c70b2df)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Creating volume bd9aeb33-cdd9-462a-a00e-3ac481f717d7 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:49:24 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:24 devstack sudo[85737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7 1073741824
Apr 16 19:49:24 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:24 devstack sudo[85734]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21bfb7e3-b42f-4496-a1f9-df60153828d7" returned: 0 in 0.534s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21bfb7e3-b42f-4496-a1f9-df60153828d7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:24 devstack sudo[85742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21bfb7e3-b42f-4496-a1f9-df60153828d7
Apr 16 19:49:24 devstack sudo[85742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:25 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7 1073741824" returned: 0 in 0.710s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:25 devstack sudo[85747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7
Apr 16 19:49:25 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:25 devstack sudo[85742]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21bfb7e3-b42f-4496-a1f9-df60153828d7" returned: 0 in 0.786s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Lock "cinder-quobyte-21bfb7e3-b42f-4496-a1f9-df60153828d7" released by "delete_volume" :: held 1.408s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG cinder.quota [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Created reservations ['a4a6ab51-7345-484b-995d-7365fc332252', 'a2484873-f155-4cc2-bead-081ecf26f64a', '24b40013-49c6-4482-addf-049fe4d2c43e', 'cafdc4e1-005d-4226-bd72-da8539d847fe'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:25 devstack sudo[85752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:25 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:25 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7" returned: 0 in 0.539s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f7e9a6-0017-4e9c-ac39-852433ac19d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cb2f76-8e6c-46da-add8-0a342f7c9854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:25 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Volume volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7 (bd9aeb33-cdd9-462a-a00e-3ac481f717d7): created successfully
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cb2f76-8e6c-46da-add8-0a342f7c9854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Flow 'volume_create_manager' (b4cc2674-a1bc-438a-8734-ad809a42a88f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:25 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-14050623-5d81-4ade-a5ba-0fbe2ab1ebc0 tempest-GroupsTest-386831391 None] Created volume successfully.
Apr 16 19:49:26 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.465s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:26 devstack cinder-volume[82616]: DEBUG cinder.manager [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:26 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Deleted volume successfully.
Apr 16 19:49:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-42dce697-668a-4a58-bace-c4b855869944 req-a09ca83d-a6d4-4012-81b6-74528f97e888 tempest-VolumesGetTestJSON-1107098147 None] Lock "cinder-21bfb7e3-b42f-4496-a1f9-df60153828d7-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Flow 'volume_create_manager' (beca6fae-291e-4aca-afd1-dfcb93791873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dceea6e-e669-4bc7-9950-2f4d5cc8a399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dceea6e-e669-4bc7-9950-2f4d5cc8a399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-772601005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e21e0bc2-5b3d-4115-a8db-ae7c955ee93e,host='devstack@QuobyteHD#QuobyteHD',id=d202176e-0a14-49e1-a7c5-ef0ac6d5a5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598c06c19bcc4daa9424f1c471f29070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:27Z,use_quota=True,user_id='74233dc3dcd1427b91ae2fb67c4c641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a8a4e4d-a1c2-41eb-92a2-9a057c70b2df),volume_type_id=2a8a4e4d-a1c2-41eb-92a2-9a057c70b2df)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad231e63-43f8-4640-948f-78b000c5effe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad231e63-43f8-4640-948f-78b000c5effe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e71f46-a484-4e04-ae88-f0a001e61f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e71f46-a484-4e04-ae88-f0a001e61f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd202176e-0a14-49e1-a7c5-ef0ac6d5a5de', 'volume_name': 'volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dd2c74-e719-49bd-978a-b10645b7ec07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dd2c74-e719-49bd-978a-b10645b7ec07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b7582b-69a0-4380-8c9b-e6fc2fc8a97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:27 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Volume d202176e-0a14-49e1-a7c5-ef0ac6d5a5de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de', 'volume_size': 1}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e21e0bc2-5b3d-4115-a8db-ae7c955ee93e,created_at=2026-04-16T17:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-772601005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e21e0bc2-5b3d-4115-a8db-ae7c955ee93e,host='devstack@QuobyteHD#QuobyteHD',id=d202176e-0a14-49e1-a7c5-ef0ac6d5a5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598c06c19bcc4daa9424f1c471f29070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:27Z,use_quota=True,user_id='74233dc3dcd1427b91ae2fb67c4c641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a8a4e4d-a1c2-41eb-92a2-9a057c70b2df),volume_type_id=2a8a4e4d-a1c2-41eb-92a2-9a057c70b2df)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Creating volume d202176e-0a14-49e1-a7c5-ef0ac6d5a5de {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:49:27 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:27 devstack sudo[85758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de 1073741824
Apr 16 19:49:27 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:27 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de 1073741824" returned: 0 in 0.570s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:27 devstack sudo[85773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de
Apr 16 19:49:27 devstack sudo[85773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:28 devstack sudo[85773]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de" returned: 0 in 0.952s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:49:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b7582b-69a0-4380-8c9b-e6fc2fc8a97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9349c2a6-6c0f-40fb-b43c-f9b543439eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:28 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Volume volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de (d202176e-0a14-49e1-a7c5-ef0ac6d5a5de): created successfully
Apr 16 19:49:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9349c2a6-6c0f-40fb-b43c-f9b543439eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Flow 'volume_create_manager' (beca6fae-291e-4aca-afd1-dfcb93791873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:28 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-9090cb6c-d31e-4f53-bdaf-6089887c4d67 tempest-GroupsTest-386831391 None] Created volume successfully.
Apr 16 19:49:29 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7d4736a5-140e-470a-88ca-1f5b77a17e12 tempest-GroupsTest-386831391 None] Update group completed successfully.
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Flow 'volume_create_manager' (af57214e-3d80-4e61-9373-9890fe66c9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00684223-6105-402b-b88b-9257067a046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00684223-6105-402b-b88b-9257067a046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1604895709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d410e3-b909-479c-a6fc-cf909a24eabc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66438a3042ed46188a26ed3306246a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:30Z,use_quota=True,user_id='f9db3c6d71e64687aa1b8e66501efd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c0858a-de34-4cfc-9ad7-21760a85795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c0858a-de34-4cfc-9ad7-21760a85795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e34ff0-f310-4674-aa02-fe505784d99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e34ff0-f310-4674-aa02-fe505784d99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83d410e3-b909-479c-a6fc-cf909a24eabc', 'volume_name': 'volume-83d410e3-b909-479c-a6fc-cf909a24eabc', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a032ad-8736-4226-a05a-ab88ae61ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a032ad-8736-4226-a05a-ab88ae61ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2d4130-bcb2-4e3b-af42-66dd50d1d0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:29 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Volume 83d410e3-b909-479c-a6fc-cf909a24eabc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83d410e3-b909-479c-a6fc-cf909a24eabc', 'volume_size': 1}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1604895709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d410e3-b909-479c-a6fc-cf909a24eabc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66438a3042ed46188a26ed3306246a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:30Z,use_quota=True,user_id='f9db3c6d71e64687aa1b8e66501efd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Creating volume 83d410e3-b909-479c-a6fc-cf909a24eabc {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:49:29 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:49:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-83d410e3-b909-479c-a6fc-cf909a24eabc 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:29 devstack sudo[85846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-83d410e3-b909-479c-a6fc-cf909a24eabc 1073741824
Apr 16 19:49:29 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:30 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-83d410e3-b909-479c-a6fc-cf909a24eabc 1073741824" returned: 0 in 0.605s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-83d410e3-b909-479c-a6fc-cf909a24eabc {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:30 devstack sudo[85858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-83d410e3-b909-479c-a6fc-cf909a24eabc
Apr 16 19:49:30 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:30 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-14fb1ecb-7e9a-4f57-bacd-028f9047c609 tempest-GroupsTest-386831391 None] Update group completed successfully.
Apr 16 19:49:31 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-83d410e3-b909-479c-a6fc-cf909a24eabc" returned: 0 in 0.603s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2d4130-bcb2-4e3b-af42-66dd50d1d0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d410e3-b909-479c-a6fc-cf909a24eabc', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8d4c8c-86f2-43bc-83b6-acb641441ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:31 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Volume volume-83d410e3-b909-479c-a6fc-cf909a24eabc (83d410e3-b909-479c-a6fc-cf909a24eabc): created successfully
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8d4c8c-86f2-43bc-83b6-acb641441ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Flow 'volume_create_manager' (af57214e-3d80-4e61-9373-9890fe66c9d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:31 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-9e690100-6540-4bb5-abef-4188c742f6eb tempest-VolumesTestJSON-1815572371 None] Created volume successfully.
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Flow 'volume_create_manager' (b7c2b9ab-1d64-420f-8597-5ac0a1a46220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49859bf-40d9-4c1f-a700-2d5874d04847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49859bf-40d9-4c1f-a700-2d5874d04847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1908983340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42b0c89-89e7-4930-bb38-27424509efcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbc91fe3fd43d084a56377cdfeeed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:32Z,use_quota=True,user_id='1536ffd661f74399b0aa33a6154f3780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed529d98-ddfb-4b8e-87fb-816f5675b326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed529d98-ddfb-4b8e-87fb-816f5675b326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d5b3a8-5136-4435-b3fe-f82bb7f5fd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d5b3a8-5136-4435-b3fe-f82bb7f5fd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c42b0c89-89e7-4930-bb38-27424509efcb', 'volume_name': 'volume-c42b0c89-89e7-4930-bb38-27424509efcb', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed67513-080c-4719-8172-ee415d0d25df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed67513-080c-4719-8172-ee415d0d25df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb2ae03-6822-49f5-a00f-9e2a1a0d7fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:31 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Volume c42b0c89-89e7-4930-bb38-27424509efcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c42b0c89-89e7-4930-bb38-27424509efcb', 'volume_size': 1}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1908983340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42b0c89-89e7-4930-bb38-27424509efcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbc91fe3fd43d084a56377cdfeeed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:32Z,use_quota=True,user_id='1536ffd661f74399b0aa33a6154f3780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Creating volume c42b0c89-89e7-4930-bb38-27424509efcb {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:49:31 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:49:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c42b0c89-89e7-4930-bb38-27424509efcb 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:31 devstack sudo[85867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c42b0c89-89e7-4930-bb38-27424509efcb 1073741824
Apr 16 19:49:31 devstack sudo[85867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Acquiring lock "cinder-quobyte-bd9aeb33-cdd9-462a-a00e-3ac481f717d7" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Lock "cinder-quobyte-bd9aeb33-cdd9-462a-a00e-3ac481f717d7" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb117a83-efac-4fb8-bc43-1bbdef46da30]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:49:32 devstack sudo[85869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7
Apr 16 19:49:32 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Flow 'volume_create_manager' (4b95506f-4433-411e-a997-31b213442734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecb9710-4d77-4bac-a8af-f2af9680cf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecb9710-4d77-4bac-a8af-f2af9680cf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-599313160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2661d3b-99b8-4020-8daf-2ad73724bad4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66438a3042ed46188a26ed3306246a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:32Z,use_quota=True,user_id='f9db3c6d71e64687aa1b8e66501efd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb847ec5-275e-4ccf-ba0d-68abace0e41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb847ec5-275e-4ccf-ba0d-68abace0e41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a3cb87-dab7-4c73-ae41-a35d8569d004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a3cb87-dab7-4c73-ae41-a35d8569d004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2661d3b-99b8-4020-8daf-2ad73724bad4', 'volume_name': 'volume-c2661d3b-99b8-4020-8daf-2ad73724bad4', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9089de1-6df1-4c93-a3a3-efb9291ac65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9089de1-6df1-4c93-a3a3-efb9291ac65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4424d8-8b16-4873-95a9-b4d361c8f769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:32 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Volume c2661d3b-99b8-4020-8daf-2ad73724bad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2661d3b-99b8-4020-8daf-2ad73724bad4', 'volume_size': 1}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:32 devstack sudo[85867]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c42b0c89-89e7-4930-bb38-27424509efcb 1073741824" returned: 0 in 0.901s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c42b0c89-89e7-4930-bb38-27424509efcb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:32 devstack sudo[85875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c42b0c89-89e7-4930-bb38-27424509efcb
Apr 16 19:49:32 devstack sudo[85875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:32 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7" returned: 0 in 0.623s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:32 devstack sudo[85880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7
Apr 16 19:49:32 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:33 devstack sudo[85875]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c42b0c89-89e7-4930-bb38-27424509efcb" returned: 0 in 0.492s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.835s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-599313160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2661d3b-99b8-4020-8daf-2ad73724bad4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66438a3042ed46188a26ed3306246a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:32Z,use_quota=True,user_id='f9db3c6d71e64687aa1b8e66501efd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Creating volume c2661d3b-99b8-4020-8daf-2ad73724bad4 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:49:33 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c2661d3b-99b8-4020-8daf-2ad73724bad4 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb2ae03-6822-49f5-a00f-9e2a1a0d7fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c42b0c89-89e7-4930-bb38-27424509efcb', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a17b70-72db-4242-9b45-320aba990036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:33 devstack sudo[85884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c2661d3b-99b8-4020-8daf-2ad73724bad4 1073741824
Apr 16 19:49:33 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:33 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Volume volume-c42b0c89-89e7-4930-bb38-27424509efcb (c42b0c89-89e7-4930-bb38-27424509efcb): created successfully
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a17b70-72db-4242-9b45-320aba990036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Flow 'volume_create_manager' (b7c2b9ab-1d64-420f-8597-5ac0a1a46220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:33 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-98a675df-de57-46a7-9d92-c91866c872f2 tempest-VolumesActionsTest-150020149 None] Created volume successfully.
Apr 16 19:49:33 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bd9aeb33-cdd9-462a-a00e-3ac481f717d7" returned: 0 in 0.443s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Lock "cinder-quobyte-bd9aeb33-cdd9-462a-a00e-3ac481f717d7" released by "delete_volume" :: held 1.098s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Acquiring lock "cinder-quobyte-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Lock "cinder-quobyte-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79108a7-287b-42c4-8633-bb7b28043f41]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:33 devstack sudo[85886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de
Apr 16 19:49:33 devstack sudo[85886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-46e58883-d4ba-44f3-bc10-342681975ceb tempest-VolumesActionsTest-150020149 None] Acquiring lock "cinder-c42b0c89-89e7-4930-bb38-27424509efcb" by "attach_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:33 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-46e58883-d4ba-44f3-bc10-342681975ceb tempest-VolumesActionsTest-150020149 None] Lock "cinder-c42b0c89-89e7-4930-bb38-27424509efcb" acquired by "attach_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c2661d3b-99b8-4020-8daf-2ad73724bad4 1073741824" returned: 0 in 0.645s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c2661d3b-99b8-4020-8daf-2ad73724bad4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:33 devstack sudo[85894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c2661d3b-99b8-4020-8daf-2ad73724bad4
Apr 16 19:49:33 devstack sudo[85894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:33 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-46e58883-d4ba-44f3-bc10-342681975ceb tempest-VolumesActionsTest-150020149 None] Attaching volume c42b0c89-89e7-4930-bb38-27424509efcb to instance e4cfa6fd-1933-4b4a-a736-87b8aa55c28e at mountpoint /dev/vdb on host None.
Apr 16 19:49:33 devstack sudo[85886]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de" returned: 0 in 0.607s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:34 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-46e58883-d4ba-44f3-bc10-342681975ceb tempest-VolumesActionsTest-150020149 None] Attach volume completed successfully.
Apr 16 19:49:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-46e58883-d4ba-44f3-bc10-342681975ceb tempest-VolumesActionsTest-150020149 None] Lock "cinder-c42b0c89-89e7-4930-bb38-27424509efcb" released by "attach_volume" :: held 0.163s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:34 devstack sudo[85900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de
Apr 16 19:49:34 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:34 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de" returned: 0 in 0.801s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Lock "cinder-quobyte-d202176e-0a14-49e1-a7c5-ef0ac6d5a5de" released by "delete_volume" :: held 1.441s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:34 devstack sudo[85894]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c2661d3b-99b8-4020-8daf-2ad73724bad4" returned: 0 in 0.931s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:49:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4424d8-8b16-4873-95a9-b4d361c8f769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2661d3b-99b8-4020-8daf-2ad73724bad4', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4215463-2c24-4d5f-930d-f3606f80ae77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:34 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Volume volume-c2661d3b-99b8-4020-8daf-2ad73724bad4 (c2661d3b-99b8-4020-8daf-2ad73724bad4): created successfully
Apr 16 19:49:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4215463-2c24-4d5f-930d-f3606f80ae77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Flow 'volume_create_manager' (4b95506f-4433-411e-a997-31b213442734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:34 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-14bd4e1d-b2b9-444c-b4f7-8bc2af79e957 tempest-VolumesTestJSON-1815572371 None] Created volume successfully.
Apr 16 19:49:34 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Created reservations ['fb6bbf0d-be93-4d6f-b847-da5b47fb5338'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:35 devstack cinder-volume[82616]: WARNING cinder.quota [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-158414170 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-158414170, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:49:35 devstack cinder-volume[82616]: WARNING cinder.quota [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-158414170 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-158414170, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Created reservations ['f612b8c5-1475-4c3c-9733-291aec9a9b62', 'c2bdd91a-4f56-46d5-adf3-79028c7912aa', '84028ae5-1435-4096-9317-b54f69d124e0', 'e32f40df-29c4-44fc-a9ed-40c42b63f141'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Created reservations ['2006c57c-69a8-4aac-9d87-64e5291bd69e', '451b7332-507e-4c50-a95d-849e58f7f089', '9fb3b865-9fe6-43e6-9b59-1fef71747e35', '0ffba506-c060-419e-a918-00692c47af26'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:35 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ae21e758-c11f-4aff-90cd-91f2182e9f28 tempest-VolumesActionsTest-1829236732 None] Terminate volume connection completed successfully.
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:35 devstack sudo[85929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:35 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ae21e758-c11f-4aff-90cd-91f2182e9f28 tempest-VolumesActionsTest-1829236732 None] Acquiring lock "cinder-c42b0c89-89e7-4930-bb38-27424509efcb-detach_volume" by "detach_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ae21e758-c11f-4aff-90cd-91f2182e9f28 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-c42b0c89-89e7-4930-bb38-27424509efcb-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:35 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ae21e758-c11f-4aff-90cd-91f2182e9f28 tempest-VolumesActionsTest-1829236732 None] Detaching volume c42b0c89-89e7-4930-bb38-27424509efcb from instance e4cfa6fd-1933-4b4a-a736-87b8aa55c28e.
Apr 16 19:49:35 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.578s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:35 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ae21e758-c11f-4aff-90cd-91f2182e9f28 tempest-VolumesActionsTest-1829236732 None] Detach volume completed successfully.
Apr 16 19:49:35 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-11527a3f-2cd9-4c1f-8385-e270fc4015d4 tempest-GroupsTest-386831391 None] Delete group completed successfully.
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ae21e758-c11f-4aff-90cd-91f2182e9f28 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-c42b0c89-89e7-4930-bb38-27424509efcb-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Flow 'volume_create_manager' (d764eb77-5719-4cf8-b56f-bf90989565e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56eeb50a-9692-4878-914c-ff21979a8211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56eeb50a-9692-4878-914c-ff21979a8211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1323464903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66438a3042ed46188a26ed3306246a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:36Z,use_quota=True,user_id='f9db3c6d71e64687aa1b8e66501efd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7677d746-5e26-4866-81bb-5290bf0d32ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7677d746-5e26-4866-81bb-5290bf0d32ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97f2b8e-90e5-4879-8484-68c5d3784888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97f2b8e-90e5-4879-8484-68c5d3784888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d', 'volume_name': 'volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f2a60b-b528-43da-b759-f097b687f0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f2a60b-b528-43da-b759-f097b687f0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea039cb-f692-4617-894e-84fa72443252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:35 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Volume c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d', 'volume_size': 1}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1323464903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66438a3042ed46188a26ed3306246a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:36Z,use_quota=True,user_id='f9db3c6d71e64687aa1b8e66501efd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Creating volume c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:49:35 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:49:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:35 devstack sudo[85932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d 1073741824
Apr 16 19:49:35 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-352eeb69-9482-4bdf-a275-44539c548850 tempest-VolumesActionsTest-150020149 None] Acquiring lock "cinder-c42b0c89-89e7-4930-bb38-27424509efcb-detach_volume" by "detach_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-352eeb69-9482-4bdf-a275-44539c548850 tempest-VolumesActionsTest-150020149 None] Lock "cinder-c42b0c89-89e7-4930-bb38-27424509efcb-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:36 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-352eeb69-9482-4bdf-a275-44539c548850 tempest-VolumesActionsTest-150020149 None] Volume detach called, but volume not attached.
Apr 16 19:49:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-352eeb69-9482-4bdf-a275-44539c548850 tempest-VolumesActionsTest-150020149 None] Lock "cinder-c42b0c89-89e7-4930-bb38-27424509efcb-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:36 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d 1073741824" returned: 0 in 1.036s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:37 devstack sudo[85939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d
Apr 16 19:49:37 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Acquiring lock "cinder-c42b0c89-89e7-4930-bb38-27424509efcb-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Lock "cinder-c42b0c89-89e7-4930-bb38-27424509efcb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Acquiring lock "cinder-quobyte-c42b0c89-89e7-4930-bb38-27424509efcb" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Lock "cinder-quobyte-c42b0c89-89e7-4930-bb38-27424509efcb" acquired by "delete_volume" :: waited 0.019s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:37 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9772cc3-c673-4eae-8beb-8bc039871ed6]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c42b0c89-89e7-4930-bb38-27424509efcb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:37 devstack sudo[85941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c42b0c89-89e7-4930-bb38-27424509efcb
Apr 16 19:49:37 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:37 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d" returned: 0 in 0.936s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:37 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:49:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:37 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea039cb-f692-4617-894e-84fa72443252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:37 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac63f1ad-7f79-4c7e-8ab6-ea08f1f4e437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:38 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Volume volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d (c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d): created successfully
Apr 16 19:49:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac63f1ad-7f79-4c7e-8ab6-ea08f1f4e437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Flow 'volume_create_manager' (d764eb77-5719-4cf8-b56f-bf90989565e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:38 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-d9d06742-c808-47b9-bc47-5b4e7a27d6bf tempest-VolumesTestJSON-1815572371 None] Created volume successfully.
Apr 16 19:49:38 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c42b0c89-89e7-4930-bb38-27424509efcb" returned: 0 in 1.027s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c42b0c89-89e7-4930-bb38-27424509efcb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:38 devstack sudo[85947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c42b0c89-89e7-4930-bb38-27424509efcb
Apr 16 19:49:38 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:39 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c42b0c89-89e7-4930-bb38-27424509efcb" returned: 0 in 0.709s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:39 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Lock "cinder-quobyte-c42b0c89-89e7-4930-bb38-27424509efcb" released by "delete_volume" :: held 1.788s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:39 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Created reservations ['c8f6f1fd-3f9a-430c-a72f-2c48650a559c', 'ebe6a945-37af-46f1-bc2a-fef74338f192', '7453b368-f81e-4d30-9d0d-035688c1a19d', '1a9130ec-c3f0-45ad-b26a-b08f2a14f9d0'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:39 devstack sudo[85950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:39 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:40 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.966s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:40 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:40 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Deleted volume successfully.
Apr 16 19:49:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cf1b48f6-a851-4057-839f-66e3bb9be9d2 tempest-VolumesActionsTest-150020149 None] Lock "cinder-c42b0c89-89e7-4930-bb38-27424509efcb-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Acquiring lock "cinder-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:41 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Lock "cinder-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:41 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Acquiring lock "cinder-quobyte-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:41 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Lock "cinder-quobyte-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:41 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d94a443-8a2b-431d-a47a-5de5654a4de4]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:41 devstack sudo[86004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d
Apr 16 19:49:41 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:42 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f3f79ad5-7c98-4e19-badc-e2f42710abe8 tempest-GroupsV320Test-1264433796 None] Group tempest-GroupsV320Test-Group-1477722305: creating
Apr 16 19:49:42 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f3f79ad5-7c98-4e19-badc-e2f42710abe8 tempest-GroupsV320Test-1264433796 None] Group tempest-GroupsV320Test-Group-1477722305: created successfully
Apr 16 19:49:42 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f3f79ad5-7c98-4e19-badc-e2f42710abe8 tempest-GroupsV320Test-1264433796 None] Create group completed successfully.
Apr 16 19:49:42 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d" returned: 0 in 0.993s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:42 devstack sudo[86030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d
Apr 16 19:49:42 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:42 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d" returned: 0 in 0.659s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Lock "cinder-quobyte-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d" released by "delete_volume" :: held 1.710s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:42 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Created reservations ['782c2916-5310-42f8-803f-5c48545f7a1f', '233742be-016b-4764-bc14-d19b51ed4851', '1c5270f3-38e6-4370-96c9-46ded3621c21', 'ea5d6966-6d24-4818-964c-1219d04628bf'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:42 devstack sudo[86037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:42 devstack sudo[86037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Acquiring lock "cinder-c2661d3b-99b8-4020-8daf-2ad73724bad4-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Lock "cinder-c2661d3b-99b8-4020-8daf-2ad73724bad4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Acquiring lock "cinder-quobyte-c2661d3b-99b8-4020-8daf-2ad73724bad4" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Lock "cinder-quobyte-c2661d3b-99b8-4020-8daf-2ad73724bad4" acquired by "delete_volume" :: waited 0.020s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfb41be-fafa-4b54-be5d-9146c6e0779d]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c2661d3b-99b8-4020-8daf-2ad73724bad4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:43 devstack sudo[86040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c2661d3b-99b8-4020-8daf-2ad73724bad4
Apr 16 19:49:43 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:43 devstack sudo[86037]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.633s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:43 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Deleted volume successfully.
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0baf8cc4-445f-4242-ae56-79f93c5830f5 tempest-VolumesTestJSON-1815572371 None] Lock "cinder-c8ba43e9-a1f3-4de5-bf7d-945f7cf6bd7d-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-5540d41d-c348-45ae-b2e9-25c2e0204dfb tempest-GroupsV320Test-1264433796 None] Created reservations ['4635e82b-5040-4af8-b194-cd5067bc065c'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5540d41d-c348-45ae-b2e9-25c2e0204dfb tempest-GroupsV320Test-1264433796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5540d41d-c348-45ae-b2e9-25c2e0204dfb tempest-GroupsV320Test-1264433796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5540d41d-c348-45ae-b2e9-25c2e0204dfb tempest-GroupsV320Test-1264433796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5540d41d-c348-45ae-b2e9-25c2e0204dfb tempest-GroupsV320Test-1264433796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5540d41d-c348-45ae-b2e9-25c2e0204dfb tempest-GroupsV320Test-1264433796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5540d41d-c348-45ae-b2e9-25c2e0204dfb tempest-GroupsV320Test-1264433796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:43 devstack sudo[86043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:43 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:44 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c2661d3b-99b8-4020-8daf-2ad73724bad4" returned: 0 in 0.677s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c2661d3b-99b8-4020-8daf-2ad73724bad4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:44 devstack sudo[86048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c2661d3b-99b8-4020-8daf-2ad73724bad4
Apr 16 19:49:44 devstack sudo[86048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:44 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5540d41d-c348-45ae-b2e9-25c2e0204dfb tempest-GroupsV320Test-1264433796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.530s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:44 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-5540d41d-c348-45ae-b2e9-25c2e0204dfb tempest-GroupsV320Test-1264433796 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:44 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-5540d41d-c348-45ae-b2e9-25c2e0204dfb tempest-GroupsV320Test-1264433796 None] Delete group completed successfully.
Apr 16 19:49:44 devstack sudo[86048]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c2661d3b-99b8-4020-8daf-2ad73724bad4" returned: 0 in 0.697s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:44 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Lock "cinder-quobyte-c2661d3b-99b8-4020-8daf-2ad73724bad4" released by "delete_volume" :: held 1.423s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:44 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Created reservations ['4d60953a-9e8e-4d72-b3bf-3493f9557fd0', '0838b39a-dcf4-46e0-9874-b3677ba7bbd3', 'cdf49370-b3dc-4c38-8515-d19d9252cbf9', '3959b1b4-7d66-4830-a368-3e3d74dfd1b0'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:44 devstack sudo[86075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:44 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:45 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.560s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:45 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:45 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Deleted volume successfully.
Apr 16 19:49:45 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c0f9ed9-3c49-458b-8e3b-cc17bef70f24 tempest-VolumesTestJSON-1815572371 None] Lock "cinder-c2661d3b-99b8-4020-8daf-2ad73724bad4-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:45 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Acquiring lock "cinder-83d410e3-b909-479c-a6fc-cf909a24eabc-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:45 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Lock "cinder-83d410e3-b909-479c-a6fc-cf909a24eabc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:45 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Acquiring lock "cinder-quobyte-83d410e3-b909-479c-a6fc-cf909a24eabc" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:45 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Lock "cinder-quobyte-83d410e3-b909-479c-a6fc-cf909a24eabc" acquired by "delete_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:45 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ee5ad5-0986-4a96-9e8f-71bb01ab59a2]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-83d410e3-b909-479c-a6fc-cf909a24eabc {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:45 devstack sudo[86080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-83d410e3-b909-479c-a6fc-cf909a24eabc
Apr 16 19:49:45 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:46 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-83d410e3-b909-479c-a6fc-cf909a24eabc" returned: 0 in 0.659s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-83d410e3-b909-479c-a6fc-cf909a24eabc {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:46 devstack sudo[86087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-83d410e3-b909-479c-a6fc-cf909a24eabc
Apr 16 19:49:46 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Flow 'volume_create_manager' (f75493f4-19e1-4c21-9366-e76f7853745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e23181f-3613-4d29-beda-602ce0bcad6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e23181f-3613-4d29-beda-602ce0bcad6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-515970314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65962448-b4eb-47a9-b19e-a0d8581a5b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbc91fe3fd43d084a56377cdfeeed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:47Z,use_quota=True,user_id='1536ffd661f74399b0aa33a6154f3780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c130845-8ac1-438c-a09b-b07f6b0a3eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c130845-8ac1-438c-a09b-b07f6b0a3eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a84d12-7726-41e4-ad0d-8c0107b8d3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a84d12-7726-41e4-ad0d-8c0107b8d3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65962448-b4eb-47a9-b19e-a0d8581a5b8c', 'volume_name': 'volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ebed88-c60a-46f8-9d02-4d805e5aa401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ebed88-c60a-46f8-9d02-4d805e5aa401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:46 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f971ee2-d6fd-4be2-92df-c4963935a67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:46 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Volume 65962448-b4eb-47a9-b19e-a0d8581a5b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c', 'volume_size': 1}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-515970314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65962448-b4eb-47a9-b19e-a0d8581a5b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbc91fe3fd43d084a56377cdfeeed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:47Z,use_quota=True,user_id='1536ffd661f74399b0aa33a6154f3780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Creating volume 65962448-b4eb-47a9-b19e-a0d8581a5b8c {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:49:46 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-83d410e3-b909-479c-a6fc-cf909a24eabc" returned: 0 in 0.603s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Lock "cinder-quobyte-83d410e3-b909-479c-a6fc-cf909a24eabc" released by "delete_volume" :: held 1.292s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:46 devstack sudo[86091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c 1073741824
Apr 16 19:49:46 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Created reservations ['0dc02c73-5bdf-4de9-adab-948ae2fbd316', 'b7216ab0-369e-4c1d-99a5-0091d3cd3aad', 'ca9936e0-1909-46be-ba23-a265754ac779', 'bd8aa01f-82a4-4f23-9a2d-381b27f56656'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:47 devstack sudo[86093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:47 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:47 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-2df148a4-649d-4d81-a9a6-0520549dacef req-da9feb09-f1f6-49df-a15e-d2853ef12f58 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Terminate volume connection completed successfully.
Apr 16 19:49:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-2df148a4-649d-4d81-a9a6-0520549dacef req-da9feb09-f1f6-49df-a15e-d2853ef12f58 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Deleting attachment b573f087-5a46-42e7-a806-7646c6a9c49f. {{(pid=82616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 16 19:49:47 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.553s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:47 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:47 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Deleted volume successfully.
Apr 16 19:49:47 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c 1073741824" returned: 0 in 0.692s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d1417bc-7d89-43ca-bce8-fe36f3fb9421 tempest-VolumesTestJSON-1815572371 None] Lock "cinder-83d410e3-b909-479c-a6fc-cf909a24eabc-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:47 devstack sudo[86099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c
Apr 16 19:49:47 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Acquiring lock "cinder-9a4653e4-3905-4a7a-b416-659d25279da5-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "cinder-9a4653e4-3905-4a7a-b416-659d25279da5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Acquiring lock "cinder-quobyte-9a4653e4-3905-4a7a-b416-659d25279da5" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "cinder-quobyte-9a4653e4-3905-4a7a-b416-659d25279da5" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:47 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae19d71-3b52-4a02-84c7-ac223165cecd]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:47 devstack sudo[86101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5
Apr 16 19:49:47 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:48 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c" returned: 0 in 0.605s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:48 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:49:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:48 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f971ee2-d6fd-4be2-92df-c4963935a67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:48 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397bb65a-7286-4bc3-b528-540cef080bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:48 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Volume volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c (65962448-b4eb-47a9-b19e-a0d8581a5b8c): created successfully
Apr 16 19:49:48 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397bb65a-7286-4bc3-b528-540cef080bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:48 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Flow 'volume_create_manager' (f75493f4-19e1-4c21-9366-e76f7853745c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:48 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f3918423-d6df-4705-a87b-3dbfec35eb23 tempest-VolumesActionsTest-150020149 None] Created volume successfully.
Apr 16 19:49:48 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5" returned: 0 in 0.638s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:48 devstack sudo[86106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5
Apr 16 19:49:48 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Acquiring lock "cinder-65962448-b4eb-47a9-b19e-a0d8581a5b8c-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Lock "cinder-65962448-b4eb-47a9-b19e-a0d8581a5b8c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Acquiring lock "cinder-quobyte-65962448-b4eb-47a9-b19e-a0d8581a5b8c" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Lock "cinder-quobyte-65962448-b4eb-47a9-b19e-a0d8581a5b8c" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bc4a7d-e376-4db3-afeb-0041921c6770]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:49 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5" returned: 1 in 0.741s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:49 devstack sudo[86112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5
Apr 16 19:49:49 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:49 devstack sudo[86111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c
Apr 16 19:49:49 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:49 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9a4653e4-3905-4a7a-b416-659d25279da5" returned: 0 in 0.571s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "cinder-quobyte-9a4653e4-3905-4a7a-b416-659d25279da5" released by "delete_volume" :: held 2.019s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG cinder.quota [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Created reservations ['2a4e4765-afc2-4580-92f6-1abfb2b57038', '090d50d4-0134-43e1-a1ad-bf20ed9eda45', 'e0eda6c1-67f6-422b-9316-ef2c75d7df0d', 'e52e8c1a-6227-4bf2-a34b-e52021f42cee'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:49 devstack sudo[86119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:49 devstack sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:49 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c" returned: 0 in 0.767s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:50 devstack sudo[86121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c
Apr 16 19:49:50 devstack sudo[86121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:50 devstack sudo[86119]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.568s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:50 devstack cinder-volume[82616]: DEBUG cinder.manager [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:50 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Deleted volume successfully.
Apr 16 19:49:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-2df148a4-649d-4d81-a9a6-0520549dacef req-dd403822-15a9-4a9a-a905-fd66f03916db tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "cinder-9a4653e4-3905-4a7a-b416-659d25279da5-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:50 devstack sudo[86121]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-65962448-b4eb-47a9-b19e-a0d8581a5b8c" returned: 0 in 0.685s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Lock "cinder-quobyte-65962448-b4eb-47a9-b19e-a0d8581a5b8c" released by "delete_volume" :: held 1.479s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:50 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Created reservations ['4c14a06a-2e77-4ae7-aea7-1a23fcab7176', 'ba9b90c0-b645-4f86-9bbd-ee2866afbc91', '25a44608-47a0-403f-88ac-f46e7b99aee1', 'b36d11a9-7ca7-4382-b6a0-1886b5637864'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:50 devstack sudo[86125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:50 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:51 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-422d4a0d-8299-47a9-a0d2-40c21b5f1dc1 tempest-GroupSnapshotsV319Test-801595651 None] Group tempest-GroupSnapshotsV319Test-Group-2083370377: creating
Apr 16 19:49:51 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-422d4a0d-8299-47a9-a0d2-40c21b5f1dc1 tempest-GroupSnapshotsV319Test-801595651 None] Group tempest-GroupSnapshotsV319Test-Group-2083370377: created successfully
Apr 16 19:49:51 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-422d4a0d-8299-47a9-a0d2-40c21b5f1dc1 tempest-GroupSnapshotsV319Test-801595651 None] Create group completed successfully.
Apr 16 19:49:51 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.538s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:51 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Deleted volume successfully.
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5ebb35ac-12a3-4efd-9394-0c2b96df033d tempest-VolumesActionsTest-1829236732 None] Lock "cinder-65962448-b4eb-47a9-b19e-a0d8581a5b8c-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Flow 'volume_create_manager' (bf68d493-12e8-4445-a17c-cd5bd20bbf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024cf5a3-d9ee-4a07-a171-b73373710c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024cf5a3-d9ee-4a07-a171-b73373710c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1235669727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b283f4-98a1-4062-9124-e9c20b20dc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbc91fe3fd43d084a56377cdfeeed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:52Z,use_quota=True,user_id='1536ffd661f74399b0aa33a6154f3780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c89ae2d-a997-4db3-828b-2a86b61479cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c89ae2d-a997-4db3-828b-2a86b61479cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12d2353-68c5-4b59-96ca-26e7c64fc524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12d2353-68c5-4b59-96ca-26e7c64fc524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27b283f4-98a1-4062-9124-e9c20b20dc54', 'volume_name': 'volume-27b283f4-98a1-4062-9124-e9c20b20dc54', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9baaacdb-5449-402e-9115-5bd2ed544f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9baaacdb-5449-402e-9115-5bd2ed544f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf3416a-bfab-49ef-ac38-b34b37ada37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:51 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Volume 27b283f4-98a1-4062-9124-e9c20b20dc54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27b283f4-98a1-4062-9124-e9c20b20dc54', 'volume_size': 1}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1235669727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b283f4-98a1-4062-9124-e9c20b20dc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbc91fe3fd43d084a56377cdfeeed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:52Z,use_quota=True,user_id='1536ffd661f74399b0aa33a6154f3780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Creating volume 27b283f4-98a1-4062-9124-e9c20b20dc54 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:49:51 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:49:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-27b283f4-98a1-4062-9124-e9c20b20dc54 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:51 devstack sudo[86129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-27b283f4-98a1-4062-9124-e9c20b20dc54 1073741824
Apr 16 19:49:51 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:52 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-27b283f4-98a1-4062-9124-e9c20b20dc54 1073741824" returned: 0 in 0.731s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-27b283f4-98a1-4062-9124-e9c20b20dc54 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:52 devstack sudo[86161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-27b283f4-98a1-4062-9124-e9c20b20dc54
Apr 16 19:49:52 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Flow 'volume_create_manager' (30e20be1-b412-4684-8023-19139e003f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c50cfa-df9d-42d8-972e-e2ae48295b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c50cfa-df9d-42d8-972e-e2ae48295b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1839065729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b5377c03-fa2c-4f98-a733-ab0e4d11456d,host='devstack@QuobyteHD#QuobyteHD',id=5fbe27df-9fa9-440a-a821-a86720cbb04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024992e6ac354fe7b5feb53749a0ba07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:53Z,use_quota=True,user_id='bab4e1ad59a844cc8120be7d92ac228d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(101ffb3a-95ce-42ef-b7a4-b48d8b191cd7),volume_type_id=101ffb3a-95ce-42ef-b7a4-b48d8b191cd7)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dc73ca-7c18-48e6-86c8-bfcb53f6344a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dc73ca-7c18-48e6-86c8-bfcb53f6344a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59740c9-4bc1-44d0-882d-a5deac0a3d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59740c9-4bc1-44d0-882d-a5deac0a3d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fbe27df-9fa9-440a-a821-a86720cbb04b', 'volume_name': 'volume-5fbe27df-9fa9-440a-a821-a86720cbb04b', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e0a361-6305-4c7f-af42-49d5465de9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e0a361-6305-4c7f-af42-49d5465de9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ada4a0-4943-4246-9cec-035bd40ed884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:52 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Volume 5fbe27df-9fa9-440a-a821-a86720cbb04b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fbe27df-9fa9-440a-a821-a86720cbb04b', 'volume_size': 1}
Apr 16 19:49:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:53 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-27b283f4-98a1-4062-9124-e9c20b20dc54" returned: 0 in 0.642s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.247s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b5377c03-fa2c-4f98-a733-ab0e4d11456d,created_at=2026-04-16T17:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1839065729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b5377c03-fa2c-4f98-a733-ab0e4d11456d,host='devstack@QuobyteHD#QuobyteHD',id=5fbe27df-9fa9-440a-a821-a86720cbb04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024992e6ac354fe7b5feb53749a0ba07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:53Z,use_quota=True,user_id='bab4e1ad59a844cc8120be7d92ac228d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(101ffb3a-95ce-42ef-b7a4-b48d8b191cd7),volume_type_id=101ffb3a-95ce-42ef-b7a4-b48d8b191cd7)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Creating volume 5fbe27df-9fa9-440a-a821-a86720cbb04b {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:49:53 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf3416a-bfab-49ef-ac38-b34b37ada37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b283f4-98a1-4062-9124-e9c20b20dc54', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea37f938-3167-4da2-b46b-869a02b8e282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:53 devstack sudo[86165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b 1073741824
Apr 16 19:49:53 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:53 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Volume volume-27b283f4-98a1-4062-9124-e9c20b20dc54 (27b283f4-98a1-4062-9124-e9c20b20dc54): created successfully
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea37f938-3167-4da2-b46b-869a02b8e282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Flow 'volume_create_manager' (bf68d493-12e8-4445-a17c-cd5bd20bbf24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:53 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-37d7fc35-6eca-445f-a19e-6bbcd8423b20 tempest-VolumesActionsTest-150020149 None] Created volume successfully.
Apr 16 19:49:53 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b 1073741824" returned: 0 in 0.611s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:53 devstack sudo[86171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b
Apr 16 19:49:53 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Acquiring lock "cinder-27b283f4-98a1-4062-9124-e9c20b20dc54-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-27b283f4-98a1-4062-9124-e9c20b20dc54-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Acquiring lock "cinder-quobyte-27b283f4-98a1-4062-9124-e9c20b20dc54" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-quobyte-27b283f4-98a1-4062-9124-e9c20b20dc54" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10017e7-792a-4f2b-9e1e-c3173ebb260a]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-27b283f4-98a1-4062-9124-e9c20b20dc54 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:54 devstack sudo[86175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-27b283f4-98a1-4062-9124-e9c20b20dc54
Apr 16 19:49:54 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:54 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b" returned: 0 in 0.593s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ada4a0-4943-4246-9cec-035bd40ed884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fbe27df-9fa9-440a-a821-a86720cbb04b', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db53a8d-0bdb-4eb7-a802-d21d66e65c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:54 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Volume volume-5fbe27df-9fa9-440a-a821-a86720cbb04b (5fbe27df-9fa9-440a-a821-a86720cbb04b): created successfully
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db53a8d-0bdb-4eb7-a802-d21d66e65c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Flow 'volume_create_manager' (30e20be1-b412-4684-8023-19139e003f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:54 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-95673fdf-c4de-4111-b8e9-8f71b749930f tempest-GroupSnapshotsV319Test-801595651 None] Created volume successfully.
Apr 16 19:49:54 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-27b283f4-98a1-4062-9124-e9c20b20dc54" returned: 0 in 0.588s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-27b283f4-98a1-4062-9124-e9c20b20dc54 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:54 devstack sudo[86183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-27b283f4-98a1-4062-9124-e9c20b20dc54
Apr 16 19:49:54 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:55 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-27b283f4-98a1-4062-9124-e9c20b20dc54" returned: 0 in 0.455s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-quobyte-27b283f4-98a1-4062-9124-e9c20b20dc54" released by "delete_volume" :: held 1.072s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:55 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] GroupSnapshot d16c1e76-ce9f-41f5-99d7-dc2b793b802a: creating.
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Created reservations ['4f655910-b2f2-46f9-849c-ad96754f46af', '324a1100-84ae-4497-ba78-701d671fad6e', '9cc3f2d5-ad2a-41d2-9413-4ac88bd44c90', '52748964-ffbd-4db9-9c48-ee03570af86f'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] Group snapshot d16c1e76-ce9f-41f5-99d7-dc2b793b802a: creating. {{(pid=82616) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] Creating offline snapshot ebd79322-a5c2-40a3-8635-2243957f770c of volume 5fbe27df-9fa9-440a-a821-a86720cbb04b {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa2c0f3-b7a3-4979-8874-5451093c329d]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:55 devstack sudo[86187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:49:55 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:55 devstack sudo[86186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b
Apr 16 19:49:55 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:55 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.503s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:49:55 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Deleted volume successfully.
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40e150fa-7cb6-47a4-80a0-5fb495b928c5 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-27b283f4-98a1-4062-9124-e9c20b20dc54-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:49:55 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b" returned: 0 in 0.567s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:55 devstack sudo[86194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c 1G
Apr 16 19:49:55 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:56 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c 1G" returned: 0 in 0.646s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fbe27df-9fa9-440a-a821-a86720cbb04b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:56 devstack sudo[86199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fbe27df-9fa9-440a-a821-a86720cbb04b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c
Apr 16 19:49:56 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Flow 'volume_create_manager' (16273ac2-232f-46f1-9d46-c1eff648b9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46d00af-a63e-4fa2-8680-3468c499436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46d00af-a63e-4fa2-8680-3468c499436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-186232015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8d2b98-ab68-4a1c-8406-87abd3229c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbc91fe3fd43d084a56377cdfeeed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:57Z,use_quota=True,user_id='1536ffd661f74399b0aa33a6154f3780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f979b4fb-4865-478b-8165-5fba733c34de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f979b4fb-4865-478b-8165-5fba733c34de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f4545b-62af-48d6-bd4a-9833431ee774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f4545b-62af-48d6-bd4a-9833431ee774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8d2b98-ab68-4a1c-8406-87abd3229c96', 'volume_name': 'volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a5cd35-08b2-4a94-aa1c-e25a527c6567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a5cd35-08b2-4a94-aa1c-e25a527c6567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5bf6933-707a-45bc-97ff-84660bb6dc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:49:56 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Volume 2e8d2b98-ab68-4a1c-8406-87abd3229c96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96', 'volume_size': 1}
Apr 16 19:49:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:57 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fbe27df-9fa9-440a-a821-a86720cbb04b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c" returned: 0 in 0.520s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:57 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:49:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:57 devstack sudo[86204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c
Apr 16 19:49:57 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:57 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c" returned: 0 in 0.489s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:57 devstack sudo[86207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.info
Apr 16 19:49:57 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:58 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.info" returned: 0 in 0.556s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:58 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:58 devstack sudo[86211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.info
Apr 16 19:49:58 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:58 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.info" returned: 0 in 0.538s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.394s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.982s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-186232015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8d2b98-ab68-4a1c-8406-87abd3229c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbc91fe3fd43d084a56377cdfeeed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:57Z,use_quota=True,user_id='1536ffd661f74399b0aa33a6154f3780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Creating volume 2e8d2b98-ab68-4a1c-8406-87abd3229c96 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:49:58 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:49:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:58 devstack sudo[86220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96 1073741824
Apr 16 19:49:58 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:58 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-014db15b-ac03-4eb7-a276-d4d9014bae5a tempest-GroupSnapshotsV319Test-801595651 None] group_snapshot d16c1e76-ce9f-41f5-99d7-dc2b793b802a: created successfully
Apr 16 19:49:59 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root
Apr 16 19:49:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96 1073741824" returned: 0 in 0.577s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:49:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:49:59 devstack sudo[86237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96
Apr 16 19:49:59 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:49:59 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] group_snapshot d16c1e76-ce9f-41f5-99d7-dc2b793b802a: deleting
Apr 16 19:49:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] group_snapshot d16c1e76-ce9f-41f5-99d7-dc2b793b802a: deleting {{(pid=82616) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 16 19:49:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Acquiring lock "cinder-quobyte-5fbe27df-9fa9-440a-a821-a86720cbb04b" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Lock "cinder-quobyte-5fbe27df-9fa9-440a-a821-a86720cbb04b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Acquiring lock "cinder-quobyte-ebd79322-a5c2-40a3-8635-2243957f770c" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:49:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Lock "cinder-quobyte-ebd79322-a5c2-40a3-8635-2243957f770c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:49:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Deleting offline snapshot ebd79322-a5c2-40a3-8635-2243957f770c of volume 5fbe27df-9fa9-440a-a821-a86720cbb04b {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:49:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] snapshot_file for this snap is: volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:49:59 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e545c0-b4ba-4aaf-b20e-e2185d341bc5]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:49:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:00 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96" returned: 0 in 0.738s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:50:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5bf6933-707a-45bc-97ff-84660bb6dc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35307281-b4eb-49c8-ab37-9b548f530142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:00 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Volume volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96 (2e8d2b98-ab68-4a1c-8406-87abd3229c96): created successfully
Apr 16 19:50:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35307281-b4eb-49c8-ab37-9b548f530142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Flow 'volume_create_manager' (16273ac2-232f-46f1-9d46-c1eff648b9d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:00 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-859c2c6b-ded3-4515-b23b-80761df01e65 tempest-VolumesActionsTest-150020149 None] Created volume successfully.
Apr 16 19:50:00 devstack sudo[86243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c
Apr 16 19:50:00 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:00 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c" returned: 0 in 0.647s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fbe27df-9fa9-440a-a821-a86720cbb04b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:50:00 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3f21d5-e264-490f-9d6d-2d7ae326d109]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:00 devstack sudo[86252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b
Apr 16 19:50:00 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Acquiring lock "cinder-2e8d2b98-ab68-4a1c-8406-87abd3229c96-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-2e8d2b98-ab68-4a1c-8406-87abd3229c96-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Acquiring lock "cinder-quobyte-2e8d2b98-ab68-4a1c-8406-87abd3229c96" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-quobyte-2e8d2b98-ab68-4a1c-8406-87abd3229c96" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:01 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f01541e-177d-449e-b173-6a5216378f31]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:01 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b" returned: 0 in 0.594s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:01 devstack sudo[86258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c
Apr 16 19:50:01 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:01 devstack sudo[86257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96
Apr 16 19:50:01 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:01 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-08217716-529a-470b-88fd-4e54b97183d4 req-738daa6c-cba4-4fae-a29e-a15104a42fb1 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Terminate volume connection completed successfully.
Apr 16 19:50:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [req-08217716-529a-470b-88fd-4e54b97183d4 req-738daa6c-cba4-4fae-a29e-a15104a42fb1 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Deleting attachment 96112a2f-c775-42a4-aabb-08ce2ab81514. {{(pid=82616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 16 19:50:01 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96" returned: 0 in 0.598s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:01 devstack sudo[86299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96
Apr 16 19:50:01 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:01 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c" returned: 0 in 0.643s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:01 devstack sudo[86301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c
Apr 16 19:50:01 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Acquiring lock "cinder-69baa5d7-12c9-4f79-95b0-30f5324a62c0-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "cinder-69baa5d7-12c9-4f79-95b0-30f5324a62c0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Acquiring lock "cinder-quobyte-69baa5d7-12c9-4f79-95b0-30f5324a62c0" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "cinder-quobyte-69baa5d7-12c9-4f79-95b0-30f5324a62c0" acquired by "delete_volume" :: waited 0.027s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09f7d96-7807-4e5c-b31a-a0c176b625f7]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:02 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b.ebd79322-a5c2-40a3-8635-2243957f770c" returned: 0 in 0.485s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Lock "cinder-quobyte-ebd79322-a5c2-40a3-8635-2243957f770c" released by "_delete_snapshot" :: held 2.455s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Lock "cinder-quobyte-5fbe27df-9fa9-440a-a821-a86720cbb04b" released by "delete_snapshot" :: held 2.485s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:02 devstack sudo[86308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0
Apr 16 19:50:02 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:02 devstack cinder-volume[82616]: WARNING cinder.quota [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-175954495 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-175954495, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:50:02 devstack cinder-volume[82616]: WARNING cinder.quota [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-175954495 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-175954495, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:50:02 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2e8d2b98-ab68-4a1c-8406-87abd3229c96" returned: 0 in 0.648s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-quobyte-2e8d2b98-ab68-4a1c-8406-87abd3229c96" released by "delete_volume" :: held 1.290s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] Created reservations ['d614adaa-1a27-4c85-b23e-fb16056fa5f7', '846ac5aa-302f-417a-b467-54bd650370e4', '0963d417-2b81-4452-8814-3a06ef3dd9fb', '74c76abd-71b2-4a2c-8394-0b6bbd36e912'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:02 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-271135e9-a1fc-4ef4-8d1c-63a11029c55e tempest-GroupSnapshotsV319Test-801595651 None] group_snapshot d16c1e76-ce9f-41f5-99d7-dc2b793b802a: deleted successfully
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Created reservations ['ad60b7b8-9d8e-441a-b231-1e149882a7f0', '28675780-8d38-4bcb-8b8b-39d6e61aa2c0', '9f87f021-9c9f-4415-8e82-5f02e2a472cb', 'd2bc0200-2fe9-48b2-825e-5875f9343112'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:02 devstack sudo[86310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:02 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Flow 'volume_create_manager' (beaa561d-5a3d-4d68-82cd-7a5ea42fa7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4a677a-d3ff-4257-805b-60173b899a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4a677a-d3ff-4257-805b-60173b899a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2132675290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756cdaf4-6284-4d50-86c7-9766e7daca08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2eabe5a13ae488ba867cf859754d274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:03Z,use_quota=True,user_id='7197ae7fdb694d93b61fb51127d621c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ec4981a-075c-4f2e-adff-0a833693ce5f),volume_type_id=2ec4981a-075c-4f2e-adff-0a833693ce5f)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d136a48b-fba3-4491-858e-1303c69f4042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d136a48b-fba3-4491-858e-1303c69f4042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fca6f95-8788-4c2d-ad80-03e914d10d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fca6f95-8788-4c2d-ad80-03e914d10d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '756cdaf4-6284-4d50-86c7-9766e7daca08', 'volume_name': 'volume-756cdaf4-6284-4d50-86c7-9766e7daca08', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:03 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f12dd4-011a-4d6c-9265-69b2b4ef7a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f12dd4-011a-4d6c-9265-69b2b4ef7a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260d6356-69ab-411e-89a1-822000462289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:03 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Volume 756cdaf4-6284-4d50-86c7-9766e7daca08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-756cdaf4-6284-4d50-86c7-9766e7daca08', 'volume_size': 1}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2132675290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756cdaf4-6284-4d50-86c7-9766e7daca08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2eabe5a13ae488ba867cf859754d274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:03Z,use_quota=True,user_id='7197ae7fdb694d93b61fb51127d621c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ec4981a-075c-4f2e-adff-0a833693ce5f),volume_type_id=2ec4981a-075c-4f2e-adff-0a833693ce5f)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Creating volume 756cdaf4-6284-4d50-86c7-9766e7daca08 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:50:03 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-756cdaf4-6284-4d50-86c7-9766e7daca08 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0" returned: 0 in 0.729s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:03 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:03 devstack sudo[86316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-756cdaf4-6284-4d50-86c7-9766e7daca08 1073741824
Apr 16 19:50:03 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.491s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:03 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Deleted volume successfully.
Apr 16 19:50:03 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0
Apr 16 19:50:03 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-82691eaa-a71e-4322-b1b5-598bcd02ea60 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-2e8d2b98-ab68-4a1c-8406-87abd3229c96-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Acquiring lock "cinder-quobyte-5fbe27df-9fa9-440a-a821-a86720cbb04b" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Lock "cinder-quobyte-5fbe27df-9fa9-440a-a821-a86720cbb04b" acquired by "delete_volume" :: waited 0.046s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c97b72d-97ee-404f-8591-49e4b605fa1b]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:03 devstack sudo[86320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b
Apr 16 19:50:03 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:03 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-756cdaf4-6284-4d50-86c7-9766e7daca08 1073741824" returned: 0 in 0.523s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-756cdaf4-6284-4d50-86c7-9766e7daca08 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:03 devstack sudo[86326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-756cdaf4-6284-4d50-86c7-9766e7daca08
Apr 16 19:50:03 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:03 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69baa5d7-12c9-4f79-95b0-30f5324a62c0" returned: 0 in 0.582s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "cinder-quobyte-69baa5d7-12c9-4f79-95b0-30f5324a62c0" released by "delete_volume" :: held 1.342s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.quota [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Created reservations ['cd9f8169-d725-44b7-abf0-87bb3a9de77b', 'b92e9000-d38a-442b-be9f-defb40479505', 'f30111eb-2253-4b9f-a37f-95c3ba1d642c', 'feb5e936-704b-47da-aaf6-453105c13de9'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:03 devstack sudo[86328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:03 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Flow 'volume_create_manager' (bdd0fd28-db7c-4f20-8aba-3a182c9e5083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a130247d-f046-491d-ace2-ed260896f814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a130247d-f046-491d-ace2-ed260896f814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1171562031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806a9197-d992-4115-b20f-6f720c1e5f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbc91fe3fd43d084a56377cdfeeed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:04Z,use_quota=True,user_id='1536ffd661f74399b0aa33a6154f3780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9b5765-3034-4863-9312-2eea2f66028d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9b5765-3034-4863-9312-2eea2f66028d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d2be42-f2f6-47a5-ab48-a82466c465cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d2be42-f2f6-47a5-ab48-a82466c465cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '806a9197-d992-4115-b20f-6f720c1e5f2e', 'volume_name': 'volume-806a9197-d992-4115-b20f-6f720c1e5f2e', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681cbffb-570c-4e77-be84-8744f79accaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681cbffb-570c-4e77-be84-8744f79accaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc3d9e0-587c-44ba-8477-cdb54e88fa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:03 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Volume 806a9197-d992-4115-b20f-6f720c1e5f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-806a9197-d992-4115-b20f-6f720c1e5f2e', 'volume_size': 1}
Apr 16 19:50:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:04 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b" returned: 0 in 0.649s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:04 devstack sudo[86333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b
Apr 16 19:50:04 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:04 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-756cdaf4-6284-4d50-86c7-9766e7daca08" returned: 0 in 0.507s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.248s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1171562031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806a9197-d992-4115-b20f-6f720c1e5f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbc91fe3fd43d084a56377cdfeeed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:04Z,use_quota=True,user_id='1536ffd661f74399b0aa33a6154f3780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Creating volume 806a9197-d992-4115-b20f-6f720c1e5f2e {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:50:04 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-806a9197-d992-4115-b20f-6f720c1e5f2e 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260d6356-69ab-411e-89a1-822000462289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756cdaf4-6284-4d50-86c7-9766e7daca08', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835a83e6-956d-4774-8a15-1f1b1db1fb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:04 devstack sudo[86336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-806a9197-d992-4115-b20f-6f720c1e5f2e 1073741824
Apr 16 19:50:04 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:04 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Volume volume-756cdaf4-6284-4d50-86c7-9766e7daca08 (756cdaf4-6284-4d50-86c7-9766e7daca08): created successfully
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835a83e6-956d-4774-8a15-1f1b1db1fb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Flow 'volume_create_manager' (beaa561d-5a3d-4d68-82cd-7a5ea42fa7c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:04 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-55f1fa9a-ead7-4326-bacc-2648ca2ed90d tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Created volume successfully.
Apr 16 19:50:04 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.535s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.manager [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:04 devstack cinder-volume[82616]: INFO cinder.volume.manager [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Deleted volume successfully.
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [req-08217716-529a-470b-88fd-4e54b97183d4 req-b59406c0-1712-45ab-9842-7b7396621fe9 tempest-ServerBootFromVolumeStableRescueTest-750383296 None] Lock "cinder-69baa5d7-12c9-4f79-95b0-30f5324a62c0-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:04 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5fbe27df-9fa9-440a-a821-a86720cbb04b" returned: 0 in 0.460s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Lock "cinder-quobyte-5fbe27df-9fa9-440a-a821-a86720cbb04b" released by "delete_volume" :: held 1.150s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Created reservations ['8694b820-732e-4b88-b35f-301563d3b2b9'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:04 devstack cinder-volume[82616]: WARNING cinder.quota [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-175954495 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-175954495, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Created reservations ['ada20bf5-da9e-45f9-98e8-9efeac9a0879', '6c07bb3d-07f0-49ee-8faf-6bd34415f5b6', 'bb937ed9-d851-432f-932d-5c5e31b4a559', 'e2bcefb0-d46e-4bcf-aa60-2a9fffb65b7c'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:04 devstack sudo[86344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:04 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:04 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-806a9197-d992-4115-b20f-6f720c1e5f2e 1073741824" returned: 0 in 0.584s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-806a9197-d992-4115-b20f-6f720c1e5f2e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:04 devstack sudo[86346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-806a9197-d992-4115-b20f-6f720c1e5f2e
Apr 16 19:50:04 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:05 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.525s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:05 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-b33e163d-fd4f-4c9c-b000-a26501fd89be tempest-GroupSnapshotsV319Test-801595651 None] Delete group completed successfully.
Apr 16 19:50:05 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-806a9197-d992-4115-b20f-6f720c1e5f2e" returned: 0 in 0.591s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc3d9e0-587c-44ba-8477-cdb54e88fa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-806a9197-d992-4115-b20f-6f720c1e5f2e', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84aed99-3ca1-4f18-a6db-4dc10a31b25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:05 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Volume volume-806a9197-d992-4115-b20f-6f720c1e5f2e (806a9197-d992-4115-b20f-6f720c1e5f2e): created successfully
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84aed99-3ca1-4f18-a6db-4dc10a31b25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Flow 'volume_create_manager' (bdd0fd28-db7c-4f20-8aba-3a182c9e5083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:05 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-5fe2c994-1922-4070-b276-dc4f15d2c360 tempest-VolumesActionsTest-150020149 None] Created volume successfully.
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-68f71093-e41f-406b-8a4f-b4e22c74f371 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-68f71093-e41f-406b-8a4f-b4e22c74f371 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-68f71093-e41f-406b-8a4f-b4e22c74f371 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-68f71093-e41f-406b-8a4f-b4e22c74f371 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-68f71093-e41f-406b-8a4f-b4e22c74f371 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-68f71093-e41f-406b-8a4f-b4e22c74f371 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:05 devstack sudo[86351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:05 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:06 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-68f71093-e41f-406b-8a4f-b4e22c74f371 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.534s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-68f71093-e41f-406b-8a4f-b4e22c74f371 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:06 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-68f71093-e41f-406b-8a4f-b4e22c74f371 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Retype volume completed successfully.
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Acquiring lock "cinder-806a9197-d992-4115-b20f-6f720c1e5f2e-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-806a9197-d992-4115-b20f-6f720c1e5f2e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Acquiring lock "cinder-quobyte-806a9197-d992-4115-b20f-6f720c1e5f2e" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-quobyte-806a9197-d992-4115-b20f-6f720c1e5f2e" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[679a9d95-5260-4867-ab2a-99e52df989c6]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-806a9197-d992-4115-b20f-6f720c1e5f2e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:06 devstack sudo[86354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-806a9197-d992-4115-b20f-6f720c1e5f2e
Apr 16 19:50:06 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Acquiring lock "cinder-756cdaf4-6284-4d50-86c7-9766e7daca08-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Lock "cinder-756cdaf4-6284-4d50-86c7-9766e7daca08-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Acquiring lock "cinder-quobyte-756cdaf4-6284-4d50-86c7-9766e7daca08" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Lock "cinder-quobyte-756cdaf4-6284-4d50-86c7-9766e7daca08" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[83905898-5184-487b-a655-7b16de81268c]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-756cdaf4-6284-4d50-86c7-9766e7daca08 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:06 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-806a9197-d992-4115-b20f-6f720c1e5f2e" returned: 0 in 0.789s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-806a9197-d992-4115-b20f-6f720c1e5f2e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:06 devstack sudo[86383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-806a9197-d992-4115-b20f-6f720c1e5f2e
Apr 16 19:50:06 devstack sudo[86383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:06 devstack sudo[86382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-756cdaf4-6284-4d50-86c7-9766e7daca08
Apr 16 19:50:06 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:07 devstack sudo[86383]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-806a9197-d992-4115-b20f-6f720c1e5f2e" returned: 0 in 0.615s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:07 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-quobyte-806a9197-d992-4115-b20f-6f720c1e5f2e" released by "delete_volume" :: held 1.431s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:07 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Created reservations ['9ad13d0c-b6cc-4f88-8fc3-441791bc23fc', 'b3257607-bf4d-48e8-b948-a33fe2f82b83', 'cf6b61d4-9c8a-4729-99e3-ac3bd714e08d', 'c34bc628-b7d8-4cf7-9973-4788f6a0109b'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:07 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-756cdaf4-6284-4d50-86c7-9766e7daca08" returned: 0 in 0.826s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:07 devstack sudo[86394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-756cdaf4-6284-4d50-86c7-9766e7daca08 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:07 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:07 devstack sudo[86397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-756cdaf4-6284-4d50-86c7-9766e7daca08
Apr 16 19:50:07 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:08 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.621s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:08 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Deleted volume successfully.
Apr 16 19:50:08 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-756cdaf4-6284-4d50-86c7-9766e7daca08" returned: 0 in 0.643s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Lock "cinder-quobyte-756cdaf4-6284-4d50-86c7-9766e7daca08" released by "delete_volume" :: held 1.510s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0dcd7dfe-ce89-4885-8c78-e37788e27d31 tempest-VolumesActionsTest-1829236732 None] Lock "cinder-806a9197-d992-4115-b20f-6f720c1e5f2e-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:08 devstack cinder-volume[82616]: WARNING cinder.quota [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:50:08 devstack cinder-volume[82616]: WARNING cinder.quota [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Created reservations ['f56a0f6f-1f5f-4266-aaac-673d558da674', 'd9032d59-6c2b-415d-9c93-e2f034b526ff', '42076b98-4e2f-4253-8fb9-39413cfa9f6d', 'cc6d05f3-1afa-4ef7-97da-1e04c9b790d9'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:08 devstack sudo[86404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:08 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Flow 'volume_create_manager' (f78c4ff2-ad0f-4fe3-a723-e2a334247c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf5a91f-ba3e-4058-9a3c-558745a1f720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf5a91f-ba3e-4058-9a3c-558745a1f720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-330464989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b1de0c-5455-4125-8c77-fa3775c296df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbc91fe3fd43d084a56377cdfeeed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:09Z,use_quota=True,user_id='1536ffd661f74399b0aa33a6154f3780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642627d7-2f81-4e85-bd58-d229b78e7b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642627d7-2f81-4e85-bd58-d229b78e7b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5426de3b-2f6b-403d-9397-29f0b8bc3318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5426de3b-2f6b-403d-9397-29f0b8bc3318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b1de0c-5455-4125-8c77-fa3775c296df', 'volume_name': 'volume-d7b1de0c-5455-4125-8c77-fa3775c296df', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645223c5-dc2c-4f58-8d41-b7ff8e645a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645223c5-dc2c-4f58-8d41-b7ff8e645a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e583d325-32de-4b0a-a27d-d4c00140cfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:08 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Volume d7b1de0c-5455-4125-8c77-fa3775c296df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b1de0c-5455-4125-8c77-fa3775c296df', 'volume_size': 1}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-330464989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b1de0c-5455-4125-8c77-fa3775c296df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbc91fe3fd43d084a56377cdfeeed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:09Z,use_quota=True,user_id='1536ffd661f74399b0aa33a6154f3780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Creating volume d7b1de0c-5455-4125-8c77-fa3775c296df {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:50:08 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:50:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7b1de0c-5455-4125-8c77-fa3775c296df 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:08 devstack sudo[86406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7b1de0c-5455-4125-8c77-fa3775c296df 1073741824
Apr 16 19:50:08 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:09 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.721s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:09 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:09 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Deleted volume successfully.
Apr 16 19:50:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-13ef24dd-c46b-414f-bc26-2b6dbb655127 tempest-VolumeRetypeWithoutMigrationTest-625372820 None] Lock "cinder-756cdaf4-6284-4d50-86c7-9766e7daca08-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:09 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7b1de0c-5455-4125-8c77-fa3775c296df 1073741824" returned: 0 in 0.803s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7b1de0c-5455-4125-8c77-fa3775c296df {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:09 devstack sudo[86413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7b1de0c-5455-4125-8c77-fa3775c296df
Apr 16 19:50:09 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:10 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7b1de0c-5455-4125-8c77-fa3775c296df" returned: 0 in 0.561s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:50:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e583d325-32de-4b0a-a27d-d4c00140cfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b1de0c-5455-4125-8c77-fa3775c296df', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c17ad48-29e5-4558-854e-a83bc8f34fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:10 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Volume volume-d7b1de0c-5455-4125-8c77-fa3775c296df (d7b1de0c-5455-4125-8c77-fa3775c296df): created successfully
Apr 16 19:50:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c17ad48-29e5-4558-854e-a83bc8f34fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Flow 'volume_create_manager' (f78c4ff2-ad0f-4fe3-a723-e2a334247c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:10 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-058eb5f8-b202-47a3-bd5c-cf7d6f5189f6 tempest-VolumesActionsTest-150020149 None] Created volume successfully.
Apr 16 19:50:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Acquiring lock "cinder-d7b1de0c-5455-4125-8c77-fa3775c296df-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Lock "cinder-d7b1de0c-5455-4125-8c77-fa3775c296df-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Acquiring lock "cinder-quobyte-d7b1de0c-5455-4125-8c77-fa3775c296df" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:11 devstack cinder-volume[82616]: DEBUG oslo_service.periodic_task [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82616) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 19:50:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Lock "cinder-quobyte-d7b1de0c-5455-4125-8c77-fa3775c296df" acquired by "delete_volume" :: waited 0.032s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:11 devstack sudo[86416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:11 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:11 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05ccd01-ae8a-4e37-8413-e01724bd7638]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7b1de0c-5455-4125-8c77-fa3775c296df {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:11 devstack sudo[86418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7b1de0c-5455-4125-8c77-fa3775c296df
Apr 16 19:50:11 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:12 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.764s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:12 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:12 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7b1de0c-5455-4125-8c77-fa3775c296df" returned: 0 in 0.737s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7b1de0c-5455-4125-8c77-fa3775c296df {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:12 devstack sudo[86424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7b1de0c-5455-4125-8c77-fa3775c296df
Apr 16 19:50:12 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:12 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7b1de0c-5455-4125-8c77-fa3775c296df" returned: 0 in 0.601s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Lock "cinder-quobyte-d7b1de0c-5455-4125-8c77-fa3775c296df" released by "delete_volume" :: held 1.381s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:12 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Created reservations ['486d737d-8ff8-48a8-adda-83f62ce3f3c6', '20006dff-88be-4949-82b1-0c17967b5772', 'e22b0c95-83e1-4dd4-af00-e23bce63e1ef', 'd4b87a0e-3cf0-4669-a6ae-c43bc414f75e'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:13 devstack sudo[86427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:13 devstack sudo[86427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:13 devstack sudo[86427]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.553s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:13 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Deleted volume successfully.
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-18b0e493-8a5c-4f8c-8d61-206689575196 tempest-VolumesActionsTest-150020149 None] Lock "cinder-d7b1de0c-5455-4125-8c77-fa3775c296df-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Flow 'volume_create_manager' (d602d090-6ee0-4f5d-b017-17fd3dcbd1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dd0cf3-53f2-4b1f-beae-e3b82215b424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dd0cf3-53f2-4b1f-beae-e3b82215b424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1974287512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6820f5-078c-412d-8de8-a8b75801d6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865b5098e65b4df8a84c7505a64f728a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:14Z,use_quota=True,user_id='9cd222b7bf9543c2a743bc6ec79fec75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de44500a-cab9-41f7-ad7e-8362b35b21f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de44500a-cab9-41f7-ad7e-8362b35b21f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0ee3ea-07ac-466f-8377-2bbd34bb42f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0ee3ea-07ac-466f-8377-2bbd34bb42f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec6820f5-078c-412d-8de8-a8b75801d6a8', 'volume_name': 'volume-ec6820f5-078c-412d-8de8-a8b75801d6a8', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd086e5-08c1-4280-a451-61f22bed1ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd086e5-08c1-4280-a451-61f22bed1ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2739db04-f0b0-430e-bea2-91404ee0027d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:13 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Volume ec6820f5-078c-412d-8de8-a8b75801d6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec6820f5-078c-412d-8de8-a8b75801d6a8', 'volume_size': 1}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1974287512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6820f5-078c-412d-8de8-a8b75801d6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865b5098e65b4df8a84c7505a64f728a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:14Z,use_quota=True,user_id='9cd222b7bf9543c2a743bc6ec79fec75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Creating volume ec6820f5-078c-412d-8de8-a8b75801d6a8 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:50:13 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:50:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:13 devstack sudo[86431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8 1073741824
Apr 16 19:50:13 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:14 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8 1073741824" returned: 0 in 0.815s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:14 devstack sudo[86437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8
Apr 16 19:50:14 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:15 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8" returned: 0 in 0.642s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:50:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2739db04-f0b0-430e-bea2-91404ee0027d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec6820f5-078c-412d-8de8-a8b75801d6a8', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71afddcc-9bb8-462a-9e3c-8fa57215cf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:15 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Volume volume-ec6820f5-078c-412d-8de8-a8b75801d6a8 (ec6820f5-078c-412d-8de8-a8b75801d6a8): created successfully
Apr 16 19:50:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71afddcc-9bb8-462a-9e3c-8fa57215cf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Flow 'volume_create_manager' (d602d090-6ee0-4f5d-b017-17fd3dcbd1ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:15 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-5b2ca0a2-2430-4182-9bb3-a0e333b2c0f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Created volume successfully.
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Creating offline snapshot 884e3f96-d23a-4762-a565-b137752c99b8 of volume ec6820f5-078c-412d-8de8-a8b75801d6a8 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[635337a9-edba-4ec6-9174-15ac0516b555]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:16 devstack sudo[86441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8
Apr 16 19:50:16 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:16 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8" returned: 0 in 0.816s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:16 devstack sudo[86447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8 1G
Apr 16 19:50:16 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Flow 'volume_create_manager' (2c9fe31a-e270-4626-85f8-4d218264a288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426dfbb1-f452-45af-b6bc-e19f52504326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426dfbb1-f452-45af-b6bc-e19f52504326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-675270652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4ea690-3328-47ae-bd6c-7c248b765a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d40295b91f943aa91b74359a6283e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:17Z,use_quota=True,user_id='af861e63b98f4f6397424cb452e4aadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8db96e-75df-419e-8a24-39be5038a29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8db96e-75df-419e-8a24-39be5038a29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce67a297-c1ce-4cc2-bcbc-cb39a224a2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce67a297-c1ce-4cc2-bcbc-cb39a224a2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa4ea690-3328-47ae-bd6c-7c248b765a8b', 'volume_name': 'volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c54367-bd5a-43be-ad10-f95469d5150f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c54367-bd5a-43be-ad10-f95469d5150f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9984dbb-05ed-4026-bf1e-bd2cd80ee351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:17 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Volume fa4ea690-3328-47ae-bd6c-7c248b765a8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b', 'volume_size': 1}
Apr 16 19:50:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:17 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8 1G" returned: 0 in 0.817s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec6820f5-078c-412d-8de8-a8b75801d6a8 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:17 devstack sudo[86453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec6820f5-078c-412d-8de8-a8b75801d6a8 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8
Apr 16 19:50:17 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:18 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec6820f5-078c-412d-8de8-a8b75801d6a8 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8" returned: 0 in 0.593s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:18 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8 is being set with open permissions: ugo+rw
Apr 16 19:50:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:18 devstack sudo[86459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8
Apr 16 19:50:18 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:18 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8" returned: 0 in 0.612s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:18 devstack sudo[86463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.info
Apr 16 19:50:18 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:19 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.info" returned: 0 in 0.585s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:19 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.info is being set with open permissions: ugo+rw
Apr 16 19:50:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:19 devstack sudo[86466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.info
Apr 16 19:50:19 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:20 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.info" returned: 0 in 0.535s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.056s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.081s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-675270652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4ea690-3328-47ae-bd6c-7c248b765a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d40295b91f943aa91b74359a6283e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:17Z,use_quota=True,user_id='af861e63b98f4f6397424cb452e4aadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Creating volume fa4ea690-3328-47ae-bd6c-7c248b765a8b {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:50:20 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:20 devstack sudo[86470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b 1073741824
Apr 16 19:50:20 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=187,cinder:UPDATE=216,cinder:INSERT=48,cinder:DELETE=15 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:50:20 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-338e501c-5399-4c73-b485-d17555b60462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Create snapshot completed successfully
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Acquiring lock "cinder-884e3f96-d23a-4762-a565-b137752c99b8-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "cinder-884e3f96-d23a-4762-a565-b137752c99b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Acquiring lock "cinder-quobyte-ec6820f5-078c-412d-8de8-a8b75801d6a8" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "cinder-quobyte-ec6820f5-078c-412d-8de8-a8b75801d6a8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Acquiring lock "cinder-quobyte-884e3f96-d23a-4762-a565-b137752c99b8" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "cinder-quobyte-884e3f96-d23a-4762-a565-b137752c99b8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Deleting offline snapshot 884e3f96-d23a-4762-a565-b137752c99b8 of volume ec6820f5-078c-412d-8de8-a8b75801d6a8 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] snapshot_file for this snap is: volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6827767f-0447-49a6-bac4-5b7f7f9e749f]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:20 devstack sudo[86475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8
Apr 16 19:50:20 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:20 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b 1073741824" returned: 0 in 0.767s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:20 devstack sudo[86477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b
Apr 16 19:50:20 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:21 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b" returned: 0 in 0.526s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:50:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9984dbb-05ed-4026-bf1e-bd2cd80ee351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498e262b-7332-4312-8280-df3ce080aa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:21 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Volume volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b (fa4ea690-3328-47ae-bd6c-7c248b765a8b): created successfully
Apr 16 19:50:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498e262b-7332-4312-8280-df3ce080aa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:21 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Flow 'volume_create_manager' (2c9fe31a-e270-4626-85f8-4d218264a288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8" returned: 0 in 0.749s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec6820f5-078c-412d-8de8-a8b75801d6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:50:21 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-75e57230-24a5-4bca-8905-3cba802b96e6 tempest-VolumeQuotasAdminTestJSON-478438736 None] Created volume successfully.
Apr 16 19:50:21 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91ab8fc-b909-44ec-8323-0c7f58415d5b]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:21 devstack sudo[86483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8
Apr 16 19:50:21 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:22 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8" returned: 0 in 0.853s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:22 devstack sudo[86489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8
Apr 16 19:50:22 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Acquiring lock "cinder-fa4ea690-3328-47ae-bd6c-7c248b765a8b-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "cinder-fa4ea690-3328-47ae-bd6c-7c248b765a8b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:22 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=158,cinder:UPDATE=208,cinder:INSERT=42,cinder:DELETE=14 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:50:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Acquiring lock "cinder-quobyte-fa4ea690-3328-47ae-bd6c-7c248b765a8b" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "cinder-quobyte-fa4ea690-3328-47ae-bd6c-7c248b765a8b" acquired by "delete_volume" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:22 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22e81a9-55bd-4e4a-aa0a-874cf9a83691]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:22 devstack sudo[86491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b
Apr 16 19:50:22 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:23 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8" returned: 0 in 0.706s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:23 devstack sudo[86496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8
Apr 16 19:50:23 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:23 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b" returned: 0 in 0.819s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:23 devstack sudo[86501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b
Apr 16 19:50:23 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:23 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8.884e3f96-d23a-4762-a565-b137752c99b8" returned: 0 in 0.787s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "cinder-quobyte-884e3f96-d23a-4762-a565-b137752c99b8" released by "_delete_snapshot" :: held 3.194s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "cinder-quobyte-ec6820f5-078c-412d-8de8-a8b75801d6a8" released by "delete_snapshot" :: held 3.219s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:23 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Created reservations ['36c2da90-fd12-456c-b540-7bddbd350908', '332fc9a4-7003-45bb-b8bf-a56130243810', '084ed0b7-1f30-4408-afd8-d753881174f5', '78b80e65-1c28-4ac0-b75c-bb4d6705cb8a'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:24 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Delete snapshot completed successfully.
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ca487e31-385e-4e35-85e2-1a222c2d65f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "cinder-884e3f96-d23a-4762-a565-b137752c99b8-delete_snapshot" released by "delete_snapshot" :: held 3.363s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:24 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fa4ea690-3328-47ae-bd6c-7c248b765a8b" returned: 0 in 0.656s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "cinder-quobyte-fa4ea690-3328-47ae-bd6c-7c248b765a8b" released by "delete_volume" :: held 1.504s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Created reservations ['a2214d9a-55c4-4c82-8147-b1aaa7b3b367', '74016a16-ffb4-4160-8a83-fae9b93195db', 'e16eb9b3-9cbf-49b6-860f-35f029ed3f68', 'cf50e9c7-3bad-4ee5-b780-e1e40a208832'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:24 devstack sudo[86505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:24 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:24 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.610s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:24 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Deleted volume successfully.
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f96540cf-ce11-4cfd-9147-167887a825a7 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "cinder-fa4ea690-3328-47ae-bd6c-7c248b765a8b-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Acquiring lock "cinder-ec6820f5-078c-412d-8de8-a8b75801d6a8-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "cinder-ec6820f5-078c-412d-8de8-a8b75801d6a8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Acquiring lock "cinder-quobyte-ec6820f5-078c-412d-8de8-a8b75801d6a8" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "cinder-quobyte-ec6820f5-078c-412d-8de8-a8b75801d6a8" acquired by "delete_volume" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[03163f8c-ff3b-4da6-b776-3b5263bc3aeb]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:25 devstack sudo[86509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8
Apr 16 19:50:25 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Flow 'volume_create_manager' (dac06c3f-3deb-4b58-b9a4-bef4a30fc594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4cd760d-0e85-4e2a-ad85-29d09901fbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4cd760d-0e85-4e2a-ad85-29d09901fbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1765568625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5d8faa-f7c4-4e96-a932-9e981a1749b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d40295b91f943aa91b74359a6283e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:25Z,use_quota=True,user_id='af861e63b98f4f6397424cb452e4aadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a100ba81-da1b-4f43-a76f-e8ca2ee029b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a100ba81-da1b-4f43-a76f-e8ca2ee029b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3aae67-ef67-4ec8-8c22-96d8dc1b6acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3aae67-ef67-4ec8-8c22-96d8dc1b6acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb5d8faa-f7c4-4e96-a932-9e981a1749b4', 'volume_name': 'volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16a1385-87b0-4d86-8396-10c91b853805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16a1385-87b0-4d86-8396-10c91b853805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b2d791-04a3-4d3c-aa60-b804a9e1875d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:25 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Volume bb5d8faa-f7c4-4e96-a932-9e981a1749b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4', 'volume_size': 1}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1765568625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5d8faa-f7c4-4e96-a932-9e981a1749b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d40295b91f943aa91b74359a6283e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:25Z,use_quota=True,user_id='af861e63b98f4f6397424cb452e4aadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Creating volume bb5d8faa-f7c4-4e96-a932-9e981a1749b4 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:50:25 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:25 devstack sudo[86511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4 1073741824
Apr 16 19:50:25 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:25 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8" returned: 0 in 0.747s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:25 devstack sudo[86518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8
Apr 16 19:50:25 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:26 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4 1073741824" returned: 0 in 0.813s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:26 devstack sudo[86521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4
Apr 16 19:50:26 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:26 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec6820f5-078c-412d-8de8-a8b75801d6a8" returned: 0 in 0.912s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "cinder-quobyte-ec6820f5-078c-412d-8de8-a8b75801d6a8" released by "delete_volume" :: held 1.707s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Created reservations ['ccf7fd2f-d95e-49a3-8501-54f8e3037605', 'a0ade763-0901-4eb5-aa96-0c8997336953', '73e7225f-685e-4e39-9584-a1627e8a3848', '57ead866-d71d-4eeb-bdc7-19d0debbcd4d'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:26 devstack sudo[86525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:26 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:26 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4" returned: 0 in 0.802s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b2d791-04a3-4d3c-aa60-b804a9e1875d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f4d3ba-50f3-4d00-a885-8e5cc004ae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:27 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Volume volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4 (bb5d8faa-f7c4-4e96-a932-9e981a1749b4): created successfully
Apr 16 19:50:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f4d3ba-50f3-4d00-a885-8e5cc004ae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Flow 'volume_create_manager' (dac06c3f-3deb-4b58-b9a4-bef4a30fc594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:27 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0cf4d7bd-9808-4480-bd13-0c5b5fed30c5 tempest-VolumeQuotasAdminTestJSON-478438736 None] Created volume successfully.
Apr 16 19:50:27 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.683s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:27 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:27 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Deleted volume successfully.
Apr 16 19:50:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eef25156-2f53-48ed-86b3-191f6b6d0a95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1501989675 None] Lock "cinder-ec6820f5-078c-412d-8de8-a8b75801d6a8-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Flow 'volume_create_manager' (be4309e3-42cd-451b-9a28-1f5b21bec637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9236ef-d7d6-437a-b102-92f56bcc16fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9236ef-d7d6-437a-b102-92f56bcc16fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-975857624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1799db6-d993-4b84-8087-9f1508ec5e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc371a2be304ab38240749cd43af2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:28Z,use_quota=True,user_id='3f6f3aa30aa04b82a5801a94ce243ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbabfa1-a08a-4c78-a700-15fec1da56d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbabfa1-a08a-4c78-a700-15fec1da56d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f65eaf5-2800-4d77-be0e-c796c34de7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f65eaf5-2800-4d77-be0e-c796c34de7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1799db6-d993-4b84-8087-9f1508ec5e86', 'volume_name': 'volume-a1799db6-d993-4b84-8087-9f1508ec5e86', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f777b5e6-ae68-466c-b763-65873fe95bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f777b5e6-ae68-466c-b763-65873fe95bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c974f995-87bb-44e7-bf07-e5f4cbb6a6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:28 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Volume a1799db6-d993-4b84-8087-9f1508ec5e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1799db6-d993-4b84-8087-9f1508ec5e86', 'volume_size': 1}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-975857624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1799db6-d993-4b84-8087-9f1508ec5e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc371a2be304ab38240749cd43af2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:28Z,use_quota=True,user_id='3f6f3aa30aa04b82a5801a94ce243ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Creating volume a1799db6-d993-4b84-8087-9f1508ec5e86 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:50:28 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a1799db6-d993-4b84-8087-9f1508ec5e86 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:28 devstack sudo[86528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a1799db6-d993-4b84-8087-9f1508ec5e86 1073741824
Apr 16 19:50:28 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:28 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-8327bff2-0064-40f2-aca7-905efdda3123 tempest-VolumeQuotasAdminTestJSON-620886530 None] Transfer volume completed successfully.
Apr 16 19:50:28 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a1799db6-d993-4b84-8087-9f1508ec5e86 1073741824" returned: 0 in 0.732s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a1799db6-d993-4b84-8087-9f1508ec5e86 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:29 devstack sudo[86533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a1799db6-d993-4b84-8087-9f1508ec5e86
Apr 16 19:50:29 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Acquiring lock "cinder-bb5d8faa-f7c4-4e96-a932-9e981a1749b4-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Lock "cinder-bb5d8faa-f7c4-4e96-a932-9e981a1749b4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Acquiring lock "cinder-quobyte-bb5d8faa-f7c4-4e96-a932-9e981a1749b4" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Lock "cinder-quobyte-bb5d8faa-f7c4-4e96-a932-9e981a1749b4" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c240c46e-9c1d-40ce-a956-89a22f3d81fb]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:29 devstack sudo[86535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4
Apr 16 19:50:29 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:29 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a1799db6-d993-4b84-8087-9f1508ec5e86" returned: 0 in 0.675s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c974f995-87bb-44e7-bf07-e5f4cbb6a6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1799db6-d993-4b84-8087-9f1508ec5e86', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52699801-b197-4302-96a2-6cc30e5678b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:29 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Volume volume-a1799db6-d993-4b84-8087-9f1508ec5e86 (a1799db6-d993-4b84-8087-9f1508ec5e86): created successfully
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52699801-b197-4302-96a2-6cc30e5678b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:29 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Flow 'volume_create_manager' (be4309e3-42cd-451b-9a28-1f5b21bec637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:29 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a7add2ca-cd72-4be0-935b-8da0d04c2b43 tempest-AbsoluteLimitsTests-1970964464 None] Created volume successfully.
Apr 16 19:50:30 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4" returned: 0 in 0.657s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:30 devstack sudo[86542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4
Apr 16 19:50:30 devstack sudo[86542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Acquiring lock "cinder-a1799db6-d993-4b84-8087-9f1508ec5e86-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Lock "cinder-a1799db6-d993-4b84-8087-9f1508ec5e86-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Acquiring lock "cinder-quobyte-a1799db6-d993-4b84-8087-9f1508ec5e86" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Lock "cinder-quobyte-a1799db6-d993-4b84-8087-9f1508ec5e86" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1748e117-87dd-4800-b834-b8a10560787b]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a1799db6-d993-4b84-8087-9f1508ec5e86 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:30 devstack sudo[86544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a1799db6-d993-4b84-8087-9f1508ec5e86
Apr 16 19:50:30 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:30 devstack sudo[86542]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-bb5d8faa-f7c4-4e96-a932-9e981a1749b4" returned: 0 in 0.689s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Lock "cinder-quobyte-bb5d8faa-f7c4-4e96-a932-9e981a1749b4" released by "delete_volume" :: held 1.376s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Created reservations ['afc2429e-4a31-41a5-9a1f-00de4eace041', '6cf9beba-0d3d-4cac-8907-c1b9313df107', 'b54a2952-9b88-4de4-9a5b-8a66aac2e6f5', 'b6425aad-44b8-47fc-8c08-63c2f6b2bcea'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:30 devstack sudo[86557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:30 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:31 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a1799db6-d993-4b84-8087-9f1508ec5e86" returned: 0 in 0.828s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a1799db6-d993-4b84-8087-9f1508ec5e86 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:31 devstack sudo[86563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a1799db6-d993-4b84-8087-9f1508ec5e86
Apr 16 19:50:31 devstack sudo[86563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:31 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.692s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:31 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:31 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Deleted volume successfully.
Apr 16 19:50:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-57a003f5-63d8-4846-b83b-c4a3155a2dab tempest-VolumeQuotasAdminTestJSON-1013621878 None] Lock "cinder-bb5d8faa-f7c4-4e96-a932-9e981a1749b4-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:31 devstack sudo[86563]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a1799db6-d993-4b84-8087-9f1508ec5e86" returned: 0 in 0.690s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Lock "cinder-quobyte-a1799db6-d993-4b84-8087-9f1508ec5e86" released by "delete_volume" :: held 1.559s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:32 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Created reservations ['eec9c8fa-b4ac-472b-8a20-d3584445cb7c', 'caede9aa-2b94-4121-ae4a-7aace567c8a9', '6b350a48-c1df-4b6c-bd3b-481f4e750cdc', '55c461e2-1931-4d96-ab5f-7b21e172fdf9'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:32 devstack sudo[86570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:32 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:32 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.622s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:32 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:32 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Deleted volume successfully.
Apr 16 19:50:32 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-807dd9cd-1b40-45ce-8e2a-41f02574a60a tempest-AbsoluteLimitsTests-1970964464 None] Lock "cinder-a1799db6-d993-4b84-8087-9f1508ec5e86-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Flow 'volume_create_manager' (cc98723b-05c5-4607-9412-d74594fcbdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a934a1c-9b53-4167-b8fb-8573bb6edeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a934a1c-9b53-4167-b8fb-8573bb6edeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1861771594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3b0106-988d-47e4-8d46-8f8cab3bde99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484096c55b0c4bb9af1a781465959598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:34Z,use_quota=True,user_id='db0bbd98a492499c98155f99fcff46fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c05b232-fcb5-4296-83f9-df93d650b101),volume_type_id=3c05b232-fcb5-4296-83f9-df93d650b101)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e76d16-a327-42b4-abc9-e72581d3903f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e76d16-a327-42b4-abc9-e72581d3903f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0598eca-9004-45aa-a1fd-60179e6c4875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0598eca-9004-45aa-a1fd-60179e6c4875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3b0106-988d-47e4-8d46-8f8cab3bde99', 'volume_name': 'volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c599b0-ad2f-4230-b10d-c552393f0bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c599b0-ad2f-4230-b10d-c552393f0bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b827b1e-65f8-4869-b55e-90a3d5093c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:34 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Volume ec3b0106-988d-47e4-8d46-8f8cab3bde99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99', 'volume_size': 1}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1861771594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3b0106-988d-47e4-8d46-8f8cab3bde99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484096c55b0c4bb9af1a781465959598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:34Z,use_quota=True,user_id='db0bbd98a492499c98155f99fcff46fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c05b232-fcb5-4296-83f9-df93d650b101),volume_type_id=3c05b232-fcb5-4296-83f9-df93d650b101)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Creating volume ec3b0106-988d-47e4-8d46-8f8cab3bde99 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:50:34 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:34 devstack sudo[86574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99 1073741824
Apr 16 19:50:34 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:34 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99 1073741824" returned: 0 in 0.643s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:34 devstack sudo[86580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99
Apr 16 19:50:34 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:35 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99" returned: 0 in 0.674s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:50:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b827b1e-65f8-4869-b55e-90a3d5093c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078308a7-9405-4d59-aad0-b3b387db9790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:35 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Volume volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99 (ec3b0106-988d-47e4-8d46-8f8cab3bde99): created successfully
Apr 16 19:50:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078308a7-9405-4d59-aad0-b3b387db9790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Flow 'volume_create_manager' (cc98723b-05c5-4607-9412-d74594fcbdf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:35 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-10f2feee-d7b8-4ecc-9fb8-13ed88308360 tempest-VolumeTypesAccessTest-475099317 None] Created volume successfully.
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Acquiring lock "cinder-ec3b0106-988d-47e4-8d46-8f8cab3bde99-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Lock "cinder-ec3b0106-988d-47e4-8d46-8f8cab3bde99-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Acquiring lock "cinder-quobyte-ec3b0106-988d-47e4-8d46-8f8cab3bde99" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Lock "cinder-quobyte-ec3b0106-988d-47e4-8d46-8f8cab3bde99" acquired by "delete_volume" :: waited 0.017s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[189e8193-32be-4630-af3a-66e78874a372]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:36 devstack sudo[86583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99
Apr 16 19:50:36 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Flow 'volume_create_manager' (a52b46bd-2381-4421-8441-922f5f9e156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9583508f-05d6-4eb7-a2b1-9546ffe3fc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9583508f-05d6-4eb7-a2b1-9546ffe3fc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1046797448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e05bc82-9182-4d15-b4c2-e2c718e7e40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac1626501ea4f66a0fdc8dbff6a9646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:37Z,use_quota=True,user_id='72e3558c068c47158aea6c81caf98533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b690aa12-6026-4132-a8ad-21f0fd3f5218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b690aa12-6026-4132-a8ad-21f0fd3f5218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cade075-4022-49b5-8731-2ce6da27f696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cade075-4022-49b5-8731-2ce6da27f696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e05bc82-9182-4d15-b4c2-e2c718e7e40e', 'volume_name': 'volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a0c3ec-207e-4866-b108-9535bfe2122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a0c3ec-207e-4866-b108-9535bfe2122b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ee014c-bda8-49d8-a610-3e0a1da0fe5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:36 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Volume 7e05bc82-9182-4d15-b4c2-e2c718e7e40e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e', 'volume_size': 1}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1046797448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e05bc82-9182-4d15-b4c2-e2c718e7e40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac1626501ea4f66a0fdc8dbff6a9646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:37Z,use_quota=True,user_id='72e3558c068c47158aea6c81caf98533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Creating volume 7e05bc82-9182-4d15-b4c2-e2c718e7e40e {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:50:36 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:50:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:36 devstack sudo[86585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e 1073741824
Apr 16 19:50:36 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:37 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99" returned: 0 in 0.734s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:37 devstack sudo[86590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99
Apr 16 19:50:37 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:37 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e 1073741824" returned: 0 in 1.043s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:37 devstack sudo[86609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e
Apr 16 19:50:37 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:37 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ec3b0106-988d-47e4-8d46-8f8cab3bde99" returned: 0 in 0.912s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Lock "cinder-quobyte-ec3b0106-988d-47e4-8d46-8f8cab3bde99" released by "delete_volume" :: held 1.699s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:38 devstack cinder-volume[82616]: WARNING cinder.quota [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-778799325 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-778799325, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:50:38 devstack cinder-volume[82616]: WARNING cinder.quota [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-778799325 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-778799325, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Created reservations ['33b73a03-e0e9-417a-b66e-2a32765daf98', '84e21e64-d9af-43ee-9f4d-33f1d491235d', '32f6cf19-600d-4bab-a538-173d67eb35a8', 'a6aff98f-87cf-4c7e-9fb7-8cb27bcf63d9'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:38 devstack sudo[86615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:38 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:38 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" returned: 0 in 0.766s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ee014c-bda8-49d8-a610-3e0a1da0fe5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb4f760-0404-496a-8162-5cc41e3e6983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:38 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Volume volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e (7e05bc82-9182-4d15-b4c2-e2c718e7e40e): created successfully
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb4f760-0404-496a-8162-5cc41e3e6983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Flow 'volume_create_manager' (a52b46bd-2381-4421-8441-922f5f9e156f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:38 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-bf3e46f9-b970-4d69-bd0c-777cd47c2eba tempest-VolumesDeleteCascade-2077433137 None] Created volume successfully.
Apr 16 19:50:38 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.808s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:38 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:38 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Deleted volume successfully.
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a3795c2d-5765-4747-8b4c-43ef8452a7c8 tempest-VolumeTypesAccessTest-475099317 None] Lock "cinder-ec3b0106-988d-47e4-8d46-8f8cab3bde99-delete_volume" released by "delete_volume" :: held 2.777s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] Creating offline snapshot 6ff877ec-a6ff-4273-83ca-64c5bab8e10c of volume 7e05bc82-9182-4d15-b4c2-e2c718e7e40e {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d49029-bbd4-49ac-83a7-99dcb462cc92]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Flow 'volume_create_manager' (7dd94cf8-84de-4089-b001-6caaeacfd11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ca33c3-d58a-4b6e-951f-2d4bb2aacd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ca33c3-d58a-4b6e-951f-2d4bb2aacd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-117463118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cf5f55-bef0-488b-b2ef-7a9548fc8054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2351360abdab4123980965db381b76aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:39Z,use_quota=True,user_id='1a820c72124a4f64908e0ee995c172be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6387de74-6cef-46ae-aded-4dfa6175455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6387de74-6cef-46ae-aded-4dfa6175455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77de8d5-7fa7-4cae-8bb5-27976e330f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77de8d5-7fa7-4cae-8bb5-27976e330f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4cf5f55-bef0-488b-b2ef-7a9548fc8054', 'volume_name': 'volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f26396-b389-452b-8312-e61383263709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f26396-b389-452b-8312-e61383263709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7292bea9-eeed-4e27-9c04-24a2467af88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:39 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Volume c4cf5f55-bef0-488b-b2ef-7a9548fc8054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054', 'volume_size': 1}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:39 devstack sudo[86619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e
Apr 16 19:50:39 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:39 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" returned: 0 in 0.627s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:39 devstack sudo[86639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c 1G
Apr 16 19:50:39 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:40 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c 1G" returned: 0 in 0.699s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:40 devstack sudo[86646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c
Apr 16 19:50:40 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:41 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c" returned: 0 in 0.610s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:41 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c is being set with open permissions: ugo+rw
Apr 16 19:50:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:41 devstack sudo[86651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c
Apr 16 19:50:41 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:41 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c" returned: 0 in 0.502s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:41 devstack sudo[86654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.info
Apr 16 19:50:41 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:42 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.info" returned: 0 in 0.547s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:42 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.info is being set with open permissions: ugo+rw
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:42 devstack sudo[86660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.info
Apr 16 19:50:42 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:42 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.info" returned: 0 in 0.568s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.634s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.516s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-117463118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cf5f55-bef0-488b-b2ef-7a9548fc8054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2351360abdab4123980965db381b76aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:39Z,use_quota=True,user_id='1a820c72124a4f64908e0ee995c172be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Creating volume c4cf5f55-bef0-488b-b2ef-7a9548fc8054 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:50:42 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:50:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:42 devstack sudo[86663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054 1073741824
Apr 16 19:50:42 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:42 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1b9d643d-1e05-4043-89d4-5505498a86a6 tempest-VolumesDeleteCascade-2077433137 None] Create snapshot completed successfully
Apr 16 19:50:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:43 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054 1073741824" returned: 0 in 0.857s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:43 devstack sudo[86696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054
Apr 16 19:50:43 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:44 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054" returned: 0 in 0.629s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:50:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.827s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7292bea9-eeed-4e27-9c04-24a2467af88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b34aba9-27cf-4788-b288-3aac2a87d43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] Creating offline snapshot 4add3db4-7f96-4dd8-9b2a-4db8514e9993 of volume 7e05bc82-9182-4d15-b4c2-e2c718e7e40e {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:50:44 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Volume volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054 (c4cf5f55-bef0-488b-b2ef-7a9548fc8054): created successfully
Apr 16 19:50:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b34aba9-27cf-4788-b288-3aac2a87d43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Flow 'volume_create_manager' (7dd94cf8-84de-4089-b001-6caaeacfd11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:44 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[73956fff-0f6f-4644-b37b-2e4ca13b72e4]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:44 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-044c9d4f-44db-4db3-9187-670e7f7e5abd tempest-VolumeQuotasNegativeTestJSON-517387011 None] Created volume successfully.
Apr 16 19:50:44 devstack sudo[86702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c
Apr 16 19:50:44 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:45 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c" returned: 0 in 0.623s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:45 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:50:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:45 devstack sudo[86708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993 1G
Apr 16 19:50:45 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:46 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993 1G" returned: 0 in 1.199s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:46 devstack sudo[86740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993
Apr 16 19:50:46 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Acquiring lock "cinder-c4cf5f55-bef0-488b-b2ef-7a9548fc8054-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Lock "cinder-c4cf5f55-bef0-488b-b2ef-7a9548fc8054-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Acquiring lock "cinder-quobyte-c4cf5f55-bef0-488b-b2ef-7a9548fc8054" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:47 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993" returned: 0 in 1.183s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:47 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993 is being set with open permissions: ugo+rw
Apr 16 19:50:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Lock "cinder-quobyte-c4cf5f55-bef0-488b-b2ef-7a9548fc8054" acquired by "delete_volume" :: waited 0.060s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:47 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8290348c-56b6-470b-a36b-17b365be5507]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:47 devstack sudo[86746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993
Apr 16 19:50:47 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:47 devstack sudo[86747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054
Apr 16 19:50:47 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:48 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993" returned: 0 in 1.007s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.160s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:48 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-d81b1070-6e4a-4931-b7e2-d68eb00a3772 tempest-VolumesDeleteCascade-2077433137 None] Create snapshot completed successfully
Apr 16 19:50:48 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054" returned: 0 in 1.079s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:48 devstack sudo[86755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054
Apr 16 19:50:48 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-7e05bc82-9182-4d15-b4c2-e2c718e7e40e-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-7e05bc82-9182-4d15-b4c2-e2c718e7e40e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Performing cascade delete. {{(pid=82616) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-4add3db4-7f96-4dd8-9b2a-4db8514e9993-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-4add3db4-7f96-4dd8-9b2a-4db8514e9993-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-quobyte-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-quobyte-4add3db4-7f96-4dd8-9b2a-4db8514e9993" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-4add3db4-7f96-4dd8-9b2a-4db8514e9993" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Deleting offline snapshot 4add3db4-7f96-4dd8-9b2a-4db8514e9993 of volume 7e05bc82-9182-4d15-b4c2-e2c718e7e40e {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] snapshot_file for this snap is: volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[681e0ada-0459-4b23-b9d7-828b476699ca]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:49 devstack sudo[86758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993
Apr 16 19:50:49 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:49 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c4cf5f55-bef0-488b-b2ef-7a9548fc8054" returned: 0 in 0.738s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Lock "cinder-quobyte-c4cf5f55-bef0-488b-b2ef-7a9548fc8054" released by "delete_volume" :: held 1.887s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Created reservations ['4ef2cfa6-8f64-4d54-a92a-12ea2e25db13', 'e7b32d5b-6d94-4a5a-8364-53afb9a5e237', '60b1213b-f9e9-461e-ac66-fb834c499c63', '6ade4c63-6598-4d5b-9279-b34995b89754'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:49 devstack sudo[86760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:50:49 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Flow 'volume_create_manager' (f029cfb9-b4aa-465e-8c9e-e05c0e529cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d20f6a8-934f-445b-ada1-8e3795297788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d20f6a8-934f-445b-ada1-8e3795297788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1779094164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1eae34-42f9-4af1-b05e-864cbe3e3e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de8e7e7e5934c4c9c62f4ffcd157745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:50Z,use_quota=True,user_id='578b8954c3864c29851c91f1d33d5de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64c654c-0fab-4997-9234-fb8c01ae0448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64c654c-0fab-4997-9234-fb8c01ae0448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5face9-2887-4ab8-980d-651449afba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5face9-2887-4ab8-980d-651449afba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd1eae34-42f9-4af1-b05e-864cbe3e3e0a', 'volume_name': 'volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e8eba6-ca75-48fb-ad05-c8a14b4cae9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e8eba6-ca75-48fb-ad05-c8a14b4cae9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40fd889-8501-4bed-a726-ef739bfed161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:49 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Volume cd1eae34-42f9-4af1-b05e-864cbe3e3e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a', 'volume_size': 1}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1779094164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1eae34-42f9-4af1-b05e-864cbe3e3e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de8e7e7e5934c4c9c62f4ffcd157745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:50Z,use_quota=True,user_id='578b8954c3864c29851c91f1d33d5de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Creating volume cd1eae34-42f9-4af1-b05e-864cbe3e3e0a {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:50:49 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:50:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:49 devstack sudo[86762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a 1073741824
Apr 16 19:50:49 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:50 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993" returned: 0 in 0.990s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:50:50 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f928c0e7-57a6-4f50-9332-3ca38854db47]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:50 devstack sudo[86767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c
Apr 16 19:50:50 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:50 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.847s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:50 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:50 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Deleted volume successfully.
Apr 16 19:50:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a5300d8-2cd3-4c87-b838-519a9a7137e9 tempest-VolumeQuotasNegativeTestJSON-517387011 None] Lock "cinder-c4cf5f55-bef0-488b-b2ef-7a9548fc8054-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:50 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c" returned: 0 in 0.808s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:50:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:51 devstack sudo[86776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993
Apr 16 19:50:51 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:51 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a 1073741824" returned: 0 in 1.369s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:51 devstack sudo[86778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a
Apr 16 19:50:51 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:52 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993" returned: 0 in 1.094s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:52 devstack sudo[86788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993
Apr 16 19:50:52 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:52 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a" returned: 0 in 0.926s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] <== create_volume: return (2367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:50:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.370s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40fd889-8501-4bed-a726-ef739bfed161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c199280-5c12-4f92-aeed-b083da5f1a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:52 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Volume volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a (cd1eae34-42f9-4af1-b05e-864cbe3e3e0a): created successfully
Apr 16 19:50:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c199280-5c12-4f92-aeed-b083da5f1a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Flow 'volume_create_manager' (f029cfb9-b4aa-465e-8c9e-e05c0e529cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:52 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-129f170f-c0b2-42f2-8b3a-4a1b056aee2b tempest-SnapshotMetadataTestJSON-2046868538 None] Created volume successfully.
Apr 16 19:50:52 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.4add3db4-7f96-4dd8-9b2a-4db8514e9993" returned: 0 in 0.915s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-4add3db4-7f96-4dd8-9b2a-4db8514e9993" released by "_delete_snapshot" :: held 3.874s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" released by "delete_snapshot" :: held 3.901s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Created reservations ['385f35ad-e9e0-4322-90fd-21213f5f9238', '1c4ba90f-8a14-4d8d-8898-f0e495d44401', '11d433ba-3d9a-434b-a0f5-5cd3cc9be96e', '1b747374-ee28-457e-a7e6-b1f9160715b8'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:53 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Delete snapshot completed successfully.
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-4add3db4-7f96-4dd8-9b2a-4db8514e9993-delete_snapshot" released by "delete_snapshot" :: held 4.135s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-6ff877ec-a6ff-4273-83ca-64c5bab8e10c-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] Creating offline snapshot 012ed6c6-90ba-439f-b625-a65389aa51c8 of volume cd1eae34-42f9-4af1-b05e-864cbe3e3e0a {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91afc4f-a696-45a0-b99b-c7dba210f1a8]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-6ff877ec-a6ff-4273-83ca-64c5bab8e10c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-quobyte-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-quobyte-6ff877ec-a6ff-4273-83ca-64c5bab8e10c" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-6ff877ec-a6ff-4273-83ca-64c5bab8e10c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Deleting offline snapshot 6ff877ec-a6ff-4273-83ca-64c5bab8e10c of volume 7e05bc82-9182-4d15-b4c2-e2c718e7e40e {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] snapshot_file for this snap is: volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[932db18d-5070-430e-8cd5-3235fb043cf4]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:53 devstack sudo[86813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a
Apr 16 19:50:53 devstack sudo[86813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:53 devstack sudo[86814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c
Apr 16 19:50:53 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:53 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c" returned: 0 in 0.706s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:50:54 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fd3b7a-bac8-47de-9a21-7fd9a8537e5c]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:54 devstack sudo[86813]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a" returned: 0 in 0.922s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:54 devstack sudo[86830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8 1G
Apr 16 19:50:54 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:54 devstack sudo[86829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e
Apr 16 19:50:54 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:54 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" returned: 0 in 0.721s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:54 devstack sudo[86839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c
Apr 16 19:50:54 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:54 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8 1G" returned: 0 in 0.800s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:54 devstack sudo[86842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8
Apr 16 19:50:54 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:55 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c" returned: 0 in 0.731s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:50:55 devstack sudo[86850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c
Apr 16 19:50:55 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Flow 'volume_create_manager' (cd1ea8e0-e926-4492-8d39-f10fc157d4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8664dc02-2d9b-4e6d-8965-cc9bd3a84c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8664dc02-2d9b-4e6d-8965-cc9bd3a84c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-265961910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e70cf2-75cb-431e-9038-0b595e0e6336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc02022b99254f95880b62e50389c2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:55Z,use_quota=True,user_id='bdedab49cb9949e3b1736bc85561bd75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a4e8a5-894e-46e2-a070-392eef2f5709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a4e8a5-894e-46e2-a070-392eef2f5709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23afafe1-e502-4c39-afb1-e51acddaa9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23afafe1-e502-4c39-afb1-e51acddaa9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e70cf2-75cb-431e-9038-0b595e0e6336', 'volume_name': 'volume-f9e70cf2-75cb-431e-9038-0b595e0e6336', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:55 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9904c7-059e-466c-a22c-2c8bad1d81b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9904c7-059e-466c-a22c-2c8bad1d81b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b17cf0d-714f-49fa-96fe-68e39b03be40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:55 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Volume f9e70cf2-75cb-431e-9038-0b595e0e6336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e70cf2-75cb-431e-9038-0b595e0e6336', 'volume_size': 1}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8" returned: 0 in 0.659s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:55 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8 is being set with open permissions: ugo+rw
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:55 devstack sudo[86852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8
Apr 16 19:50:55 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:55 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e.6ff877ec-a6ff-4273-83ca-64c5bab8e10c" returned: 0 in 0.492s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-6ff877ec-a6ff-4273-83ca-64c5bab8e10c" released by "_delete_snapshot" :: held 2.720s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" released by "delete_snapshot" :: held 2.733s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:56 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Created reservations ['e2461bf2-fc86-4735-8cb4-b39b5bb4445f', '10a51257-d195-497c-b554-a19dce33a872', '5abfdfff-49e6-4f6b-828e-a8052ecc25c5', 'c4c78340-3031-4780-a7c3-c69ead90e982'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:56 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8" returned: 0 in 0.462s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:56 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Delete snapshot completed successfully.
Apr 16 19:50:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-6ff877ec-a6ff-4273-83ca-64c5bab8e10c-delete_snapshot" released by "delete_snapshot" :: held 2.880s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Snapshots deleted, issuing volume delete {{(pid=82616) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 16 19:50:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-quobyte-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:56 devstack sudo[86857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.info
Apr 16 19:50:56 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:56 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[565380a9-c2eb-4987-aeac-c56667f8dfd2]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:56 devstack sudo[86859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e
Apr 16 19:50:56 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:56 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.info" returned: 0 in 0.567s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:56 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.info is being set with open permissions: ugo+rw
Apr 16 19:50:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:56 devstack sudo[86865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.info
Apr 16 19:50:56 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:56 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" returned: 0 in 0.613s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:56 devstack sudo[86867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e
Apr 16 19:50:56 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:57 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.info" returned: 0 in 0.465s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.979s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-265961910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e70cf2-75cb-431e-9038-0b595e0e6336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc02022b99254f95880b62e50389c2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:55Z,use_quota=True,user_id='bdedab49cb9949e3b1736bc85561bd75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Creating volume f9e70cf2-75cb-431e-9038-0b595e0e6336 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:50:57 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f9e70cf2-75cb-431e-9038-0b595e0e6336 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:57 devstack sudo[86871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f9e70cf2-75cb-431e-9038-0b595e0e6336 1073741824
Apr 16 19:50:57 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:57 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-03cf2d8b-550f-46df-aa39-1ac959977a31 tempest-SnapshotMetadataTestJSON-2046868538 None] Create snapshot completed successfully
Apr 16 19:50:57 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" returned: 0 in 0.479s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-7e05bc82-9182-4d15-b4c2-e2c718e7e40e" released by "delete_volume" :: held 1.125s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Created reservations ['ed8fbdfd-c9b3-427c-9bb1-3f3506d47683', '40aa4a65-210b-4a54-8896-145ad100c6a9', '83c7f192-fdb6-4567-a5ca-7a6d6eabcef0', '9d7d8777-22a2-4f88-8872-f2b639298e96'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:57 devstack sudo[86900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:50:57 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:58 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f9e70cf2-75cb-431e-9038-0b595e0e6336 1073741824" returned: 0 in 1.171s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Acquiring lock "cinder-012ed6c6-90ba-439f-b625-a65389aa51c8-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f9e70cf2-75cb-431e-9038-0b595e0e6336 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:58 devstack sudo[86907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f9e70cf2-75cb-431e-9038-0b595e0e6336
Apr 16 19:50:58 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "cinder-012ed6c6-90ba-439f-b625-a65389aa51c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.102s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Acquiring lock "cinder-quobyte-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "cinder-quobyte-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Acquiring lock "cinder-quobyte-012ed6c6-90ba-439f-b625-a65389aa51c8" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:50:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "cinder-quobyte-012ed6c6-90ba-439f-b625-a65389aa51c8" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:50:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Deleting offline snapshot 012ed6c6-90ba-439f-b625-a65389aa51c8 of volume cd1eae34-42f9-4af1-b05e-864cbe3e3e0a {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:50:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] snapshot_file for this snap is: volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:50:58 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3394ed-9c33-4a9c-aa2d-90f0ea092cb0]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:59 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 1.460s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:50:59 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Deleted volume successfully.
Apr 16 19:50:59 devstack sudo[86909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1cd82fe3-32bd-4c28-baf0-00f78509a9bc tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-7e05bc82-9182-4d15-b4c2-e2c718e7e40e-delete_volume" released by "delete_volume" :: held 10.129s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:50:59 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Flow 'volume_create_manager' (80269421-5ab4-4d02-bf06-815ccad665f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea920890-c3c7-4d63-a244-613307890d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea920890-c3c7-4d63-a244-613307890d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-845406874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a97d12-85a4-4857-99a7-eae3c8fcda57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac1626501ea4f66a0fdc8dbff6a9646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:59Z,use_quota=True,user_id='72e3558c068c47158aea6c81caf98533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc7b137-625d-4dc7-a92e-8f58e0b157ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc7b137-625d-4dc7-a92e-8f58e0b157ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034952db-4f71-47e3-acfc-db558a6f71d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034952db-4f71-47e3-acfc-db558a6f71d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a97d12-85a4-4857-99a7-eae3c8fcda57', 'volume_name': 'volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0789b804-c986-4579-8b10-2624425c6884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0789b804-c986-4579-8b10-2624425c6884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4b41d2-beab-4371-ade3-c981c774a4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:59 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Volume d7a97d12-85a4-4857-99a7-eae3c8fcda57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57', 'volume_size': 1}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:59 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f9e70cf2-75cb-431e-9038-0b595e0e6336" returned: 0 in 0.861s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.177s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-845406874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a97d12-85a4-4857-99a7-eae3c8fcda57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac1626501ea4f66a0fdc8dbff6a9646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:59Z,use_quota=True,user_id='72e3558c068c47158aea6c81caf98533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Creating volume d7a97d12-85a4-4857-99a7-eae3c8fcda57 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:50:59 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b17cf0d-714f-49fa-96fe-68e39b03be40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e70cf2-75cb-431e-9038-0b595e0e6336', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3209684f-63bb-4caf-8177-a4767a601e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:50:59 devstack sudo[86913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 1073741824
Apr 16 19:50:59 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:50:59 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Volume volume-f9e70cf2-75cb-431e-9038-0b595e0e6336 (f9e70cf2-75cb-431e-9038-0b595e0e6336): created successfully
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3209684f-63bb-4caf-8177-a4767a601e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Flow 'volume_create_manager' (cd1ea8e0-e926-4492-8d39-f10fc157d4b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:50:59 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ceaac8aa-87d2-43d3-bbde-69b09a1ed7fb tempest-VolumesListAdminTestJSON-288370461 None] Created volume successfully.
Apr 16 19:50:59 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8" returned: 0 in 0.930s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cc0545-b006-40b4-8b12-971ed7575cac]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:50:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:50:59 devstack sudo[86918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a
Apr 16 19:50:59 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:00 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 1073741824" returned: 0 in 0.936s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:00 devstack sudo[86923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57
Apr 16 19:51:00 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Flow 'volume_create_manager' (33d25816-d5de-47ec-a7b2-bdf0e9af5a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026b9f53-4812-4806-a651-9f8b64dd865c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026b9f53-4812-4806-a651-9f8b64dd865c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-680799565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b15b0b-7cb1-42e7-94fd-de7289527668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc02022b99254f95880b62e50389c2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:01Z,use_quota=True,user_id='bdedab49cb9949e3b1736bc85561bd75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba4f174-9004-430f-a785-8b4779e943c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba4f174-9004-430f-a785-8b4779e943c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da88998e-b4e2-4ddd-a15d-8f12c7a841aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da88998e-b4e2-4ddd-a15d-8f12c7a841aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04b15b0b-7cb1-42e7-94fd-de7289527668', 'volume_name': 'volume-04b15b0b-7cb1-42e7-94fd-de7289527668', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b60d7a-65fb-44ca-bb63-e1c8f1796bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b60d7a-65fb-44ca-bb63-e1c8f1796bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737f36b4-7433-4128-bb3d-c2a7f0a400aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:00 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Volume 04b15b0b-7cb1-42e7-94fd-de7289527668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04b15b0b-7cb1-42e7-94fd-de7289527668', 'volume_size': 1}
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:00 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a" returned: 0 in 1.239s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:01 devstack sudo[86931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8
Apr 16 19:51:01 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Flow 'volume_create_manager' (3521b051-e576-483b-90e8-1aa1251de21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0f5182-b8ec-4fdf-b0ac-ed5f587a40ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0f5182-b8ec-4fdf-b0ac-ed5f587a40ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1632057250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e3de93-1dbe-4fc0-9507-40e69455de9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e27b2acf9045c3997ae2b6e2a19577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:01Z,use_quota=True,user_id='533a570d0e7a413a87e6eec1cf7d79f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06109765-4945-475e-9fb4-da41710ceb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06109765-4945-475e-9fb4-da41710ceb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a61df4-6c9e-4865-b696-0fb7a6d4d086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a61df4-6c9e-4865-b696-0fb7a6d4d086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e3de93-1dbe-4fc0-9507-40e69455de9f', 'volume_name': 'volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6062bdd3-94f3-4c51-ab6a-2558c4e09378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6062bdd3-94f3-4c51-ab6a-2558c4e09378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68895a6-f1bb-4d02-92c7-f40f944399a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:01 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Volume a8e3de93-1dbe-4fc0-9507-40e69455de9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f', 'volume_size': 1}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:01 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57" returned: 0 in 0.867s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.459s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-680799565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b15b0b-7cb1-42e7-94fd-de7289527668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc02022b99254f95880b62e50389c2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:01Z,use_quota=True,user_id='bdedab49cb9949e3b1736bc85561bd75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Creating volume 04b15b0b-7cb1-42e7-94fd-de7289527668 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:51:01 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04b15b0b-7cb1-42e7-94fd-de7289527668 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4b41d2-beab-4371-ade3-c981c774a4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:01 devstack sudo[86933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04b15b0b-7cb1-42e7-94fd-de7289527668 1073741824
Apr 16 19:51:01 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fee37bd-9e23-4212-b00e-186d6fc62567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:01 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Volume volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 (d7a97d12-85a4-4857-99a7-eae3c8fcda57): created successfully
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fee37bd-9e23-4212-b00e-186d6fc62567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Flow 'volume_create_manager' (80269421-5ab4-4d02-bf06-815ccad665f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:01 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-897b65f7-25b1-4917-a022-2e90e9e42583 tempest-VolumesDeleteCascade-2077433137 None] Created volume successfully.
Apr 16 19:51:01 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8" returned: 0 in 0.784s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:01 devstack sudo[86941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8
Apr 16 19:51:01 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:01 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04b15b0b-7cb1-42e7-94fd-de7289527668 1073741824" returned: 0 in 0.679s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04b15b0b-7cb1-42e7-94fd-de7289527668 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:02 devstack sudo[86943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04b15b0b-7cb1-42e7-94fd-de7289527668
Apr 16 19:51:02 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:02 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04b15b0b-7cb1-42e7-94fd-de7289527668" returned: 0 in 0.524s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.311s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:02 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1632057250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e3de93-1dbe-4fc0-9507-40e69455de9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e27b2acf9045c3997ae2b6e2a19577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:01Z,use_quota=True,user_id='533a570d0e7a413a87e6eec1cf7d79f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Creating volume a8e3de93-1dbe-4fc0-9507-40e69455de9f {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:51:02 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a.012ed6c6-90ba-439f-b625-a65389aa51c8" returned: 0 in 0.840s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737f36b4-7433-4128-bb3d-c2a7f0a400aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04b15b0b-7cb1-42e7-94fd-de7289527668', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da48041f-566f-4866-9f97-57f3b71cc24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:02 devstack sudo[86979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f 1073741824
Apr 16 19:51:02 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:02 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Volume volume-04b15b0b-7cb1-42e7-94fd-de7289527668 (04b15b0b-7cb1-42e7-94fd-de7289527668): created successfully
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da48041f-566f-4866-9f97-57f3b71cc24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Flow 'volume_create_manager' (33d25816-d5de-47ec-a7b2-bdf0e9af5a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "cinder-quobyte-012ed6c6-90ba-439f-b625-a65389aa51c8" released by "_delete_snapshot" :: held 4.074s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:02 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f809f9de-854b-4a7f-bb19-75c179895093 tempest-VolumesListAdminTestJSON-288370461 None] Created volume successfully.
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "cinder-quobyte-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a" released by "delete_snapshot" :: held 4.128s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Created reservations ['e354a4c6-e3d2-42ce-ae30-73e2c3d3209c', '06e8cf0f-6045-4d54-a7ec-e349a770c515', '70d05a80-af28-4f29-9aff-289cd07de6a1', '9103db07-e3de-4927-91f9-61eaad13447e'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:02 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Delete snapshot completed successfully.
Apr 16 19:51:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-316dd45c-2282-44ef-b666-b2c524255096 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "cinder-012ed6c6-90ba-439f-b625-a65389aa51c8-delete_snapshot" released by "delete_snapshot" :: held 4.332s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Flow 'volume_create_manager' (e659b4d8-1517-4e5c-8d63-2cb5fe0f1dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73af8108-5c77-4bc9-b4cc-cd9fc1964647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73af8108-5c77-4bc9-b4cc-cd9fc1964647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-249278823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee563f7e-03ea-43b3-a619-b2ef8799fb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc02022b99254f95880b62e50389c2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:03Z,use_quota=True,user_id='bdedab49cb9949e3b1736bc85561bd75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ad7581-51ec-4de8-89e4-41734e49e7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ad7581-51ec-4de8-89e4-41734e49e7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bdea2db-a357-4bb4-abed-d250c5c03bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bdea2db-a357-4bb4-abed-d250c5c03bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee563f7e-03ea-43b3-a619-b2ef8799fb04', 'volume_name': 'volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a9a477-af4f-4a68-9e43-77cfd85c94d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a9a477-af4f-4a68-9e43-77cfd85c94d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d388e666-47e8-4ee1-b066-7aca14611c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:03 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Volume ee563f7e-03ea-43b3-a619-b2ef8799fb04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04', 'volume_size': 1}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:03 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f 1073741824" returned: 0 in 0.958s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:03 devstack sudo[86986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f
Apr 16 19:51:03 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Acquiring lock "cinder-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "cinder-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Acquiring lock "cinder-quobyte-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "cinder-quobyte-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f1b246-1e4d-4bed-ae64-ab9065a2f454]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:04 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f" returned: 0 in 0.544s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.364s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] Creating offline snapshot a0195208-e9d1-474d-ba77-006f472971ca of volume d7a97d12-85a4-4857-99a7-eae3c8fcda57 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68895a6-f1bb-4d02-92c7-f40f944399a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff150e99-f797-4596-abb6-9ca0b71f61fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:04 devstack sudo[86990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a
Apr 16 19:51:04 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec69cc2-c290-4082-9300-8287807fe84a]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:04 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Volume volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f (a8e3de93-1dbe-4fc0-9507-40e69455de9f): created successfully
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff150e99-f797-4596-abb6-9ca0b71f61fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Flow 'volume_create_manager' (3521b051-e576-483b-90e8-1aa1251de21c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:04 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-e4c18a7e-6aed-451c-bdd2-33cbf1920322 tempest-ServerRescueNegativeTestJSON-1254920346 None] Created volume successfully.
Apr 16 19:51:04 devstack sudo[86992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57
Apr 16 19:51:04 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:04 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a" returned: 0 in 0.736s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:04 devstack sudo[87001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a
Apr 16 19:51:04 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:04 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57" returned: 0 in 0.816s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:05 devstack sudo[87004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca 1G
Apr 16 19:51:05 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:05 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a" returned: 0 in 0.524s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:05 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "cinder-quobyte-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a" released by "delete_volume" :: held 1.373s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:05 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Created reservations ['93e553f7-2a58-48ad-930f-e4b229f17881', 'a799017c-360d-4b21-8e01-dc8a0ab6a538', 'fc45f31f-1a94-45cf-8305-afb877965682', '8f35f90f-f3c6-4c37-9640-f60eeb5825ed'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:05 devstack sudo[87010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:51:05 devstack sudo[87010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:05 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca 1G" returned: 0 in 0.691s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:05 devstack sudo[87012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca
Apr 16 19:51:05 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:06 devstack sudo[87010]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.599s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:06 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:51:06 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Deleted volume successfully.
Apr 16 19:51:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-745ff87a-e7d0-4c8c-8963-a2e1d0ebc523 tempest-SnapshotMetadataTestJSON-2046868538 None] Lock "cinder-cd1eae34-42f9-4af1-b05e-864cbe3e3e0a-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:06 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca" returned: 0 in 0.941s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:06 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca is being set with open permissions: ugo+rw
Apr 16 19:51:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:06 devstack sudo[87018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca
Apr 16 19:51:06 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:07 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca" returned: 0 in 0.576s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:07 devstack sudo[87022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.info
Apr 16 19:51:07 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:07 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.info" returned: 0 in 0.704s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:07 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.info is being set with open permissions: ugo+rw
Apr 16 19:51:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:07 devstack sudo[87029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.info
Apr 16 19:51:07 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:08 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.info" returned: 0 in 0.632s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.514s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.242s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-249278823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee563f7e-03ea-43b3-a619-b2ef8799fb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc02022b99254f95880b62e50389c2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:03Z,use_quota=True,user_id='bdedab49cb9949e3b1736bc85561bd75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:51:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Creating volume ee563f7e-03ea-43b3-a619-b2ef8799fb04 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:51:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:51:08 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:51:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:08 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-3cfdef4f-7888-42fb-a066-1a6b88b1aafd tempest-VolumesDeleteCascade-2077433137 None] Create snapshot completed successfully
Apr 16 19:51:08 devstack sudo[87043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04 1073741824
Apr 16 19:51:08 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Flow 'volume_create_manager' (8dcf1184-5321-4ee5-8206-af0d5cf38850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b80a569-234b-4f7f-8b7c-33210effbaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b80a569-234b-4f7f-8b7c-33210effbaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-518938683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03c819b-2a70-4ee7-833a-aac04513297b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac1626501ea4f66a0fdc8dbff6a9646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a0195208-e9d1-474d-ba77-006f472971ca,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:09Z,use_quota=True,user_id='72e3558c068c47158aea6c81caf98533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac74287-8e0d-4d6b-a054-afe5a59c24a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac74287-8e0d-4d6b-a054-afe5a59c24a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:09 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b29a470-32cd-4e8d-9c84-a2612b83f68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b29a470-32cd-4e8d-9c84-a2612b83f68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c03c819b-2a70-4ee7-833a-aac04513297b', 'volume_name': 'volume-c03c819b-2a70-4ee7-833a-aac04513297b', 'volume_size': 1, 'snapshot_id': 'a0195208-e9d1-474d-ba77-006f472971ca'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438d2907-f24e-46c7-8767-b58158831d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438d2907-f24e-46c7-8767-b58158831d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880d303f-5aa9-4e15-aa66-8af2494683a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:09 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Volume c03c819b-2a70-4ee7-833a-aac04513297b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c03c819b-2a70-4ee7-833a-aac04513297b', 'volume_size': 1, 'snapshot_id': 'a0195208-e9d1-474d-ba77-006f472971ca'}
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04 1073741824" returned: 0 in 1.007s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:09 devstack sudo[87065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04
Apr 16 19:51:09 devstack sudo[87065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Flow 'volume_create_manager' (3050d922-dcc2-4c24-a8c7-a7a04e9ce0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f17c78-0253-4a8d-9c25-5de3e93f5ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f17c78-0253-4a8d-9c25-5de3e93f5ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-714740755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ba4217-cd8b-43b9-abb1-879978b39580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae685b7f6a44a8096fae3b369b9bc47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:10Z,use_quota=True,user_id='735ff61dd7f24820bd203d4c6de1f148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacef5fa-8056-4b57-88ec-c22dc9ddf758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacef5fa-8056-4b57-88ec-c22dc9ddf758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea07189e-4986-49fc-a86a-0df6920ac5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea07189e-4986-49fc-a86a-0df6920ac5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ba4217-cd8b-43b9-abb1-879978b39580', 'volume_name': 'volume-21ba4217-cd8b-43b9-abb1-879978b39580', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ade30c4-2bc8-484b-af9c-5a2c8625c74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ade30c4-2bc8-484b-af9c-5a2c8625c74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d71b84c-077e-4c5e-af7b-de2f6c4e81f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:10 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Volume 21ba4217-cd8b-43b9-abb1-879978b39580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ba4217-cd8b-43b9-abb1-879978b39580', 'volume_size': 1}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:10 devstack sudo[87065]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04" returned: 0 in 0.566s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.587s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-quobyte-a0195208-e9d1-474d-ba77-006f472971ca-c03c819b-2a70-4ee7-833a-aac04513297b" by "_create_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d388e666-47e8-4ee1-b066-7aca14611c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45b1683-ada8-4659-8a79-b394b68963c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-a0195208-e9d1-474d-ba77-006f472971ca-c03c819b-2a70-4ee7-833a-aac04513297b" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Creating volume c03c819b-2a70-4ee7-833a-aac04513297b from snapshot a0195208-e9d1-474d-ba77-006f472971ca {{(pid=82616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-quobyte-c03c819b-2a70-4ee7-833a-aac04513297b" by "_copy_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:10 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Volume volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04 (ee563f7e-03ea-43b3-a619-b2ef8799fb04): created successfully
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45b1683-ada8-4659-8a79-b394b68963c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Flow 'volume_create_manager' (e659b4d8-1517-4e5c-8d63-2cb5fe0f1dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-c03c819b-2a70-4ee7-833a-aac04513297b" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] snapshot: a0195208-e9d1-474d-ba77-006f472971ca, volume: c03c819b-2a70-4ee7-833a-aac04513297b,  {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 19:51:10 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-d4dabe93-c816-4cdb-99cc-61d4ce1c549d tempest-VolumesListAdminTestJSON-288370461 None] Created volume successfully.
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ba39c6-3745-44d9-b556-1858c32f291c]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:10 devstack sudo[87090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca
Apr 16 19:51:10 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:10 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca" returned: 0 in 0.631s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Creating direct copy from snapshot {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dac5f9-0481-4205-a4f9-700861618f95]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:11 devstack sudo[87098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57
Apr 16 19:51:11 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Flow 'volume_create_manager' (fdb6d4e8-2cf0-4da1-8ef5-68a5d5efea33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a52fd12-aea6-4d0c-a4c7-f1b1233fd8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a52fd12-aea6-4d0c-a4c7-f1b1233fd8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30826ae9-ef6a-4244-a4be-31e409ac766c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7115012ac4d64dabaa2d9a287403b451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:11Z,use_quota=True,user_id='684249f5c8ee4c89a57eb608feb51bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a649bea-e719-4158-9879-3cafc23e3185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a649bea-e719-4158-9879-3cafc23e3185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b124ff-18f1-498d-83d7-cf3747968927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b124ff-18f1-498d-83d7-cf3747968927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30826ae9-ef6a-4244-a4be-31e409ac766c', 'volume_name': 'volume-30826ae9-ef6a-4244-a4be-31e409ac766c', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60297a8d-95a8-488a-a3db-8904038fe3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60297a8d-95a8-488a-a3db-8904038fe3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14003b1b-e962-4fed-8bba-6aeef3da8c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:11 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Volume 30826ae9-ef6a-4244-a4be-31e409ac766c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30826ae9-ef6a-4244-a4be-31e409ac766c', 'volume_size': 1}
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:11 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57" returned: 0 in 0.572s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG cinder.utils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Path /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b not found in is_blk_device check {{(pid=82616) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 19:51:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:11 devstack sudo[87103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b
Apr 16 19:51:11 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:14 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b" returned: 0 in 3.350s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:14 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e53ffc5-5bf0-462b-94e2-216ddaff70d8]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:15 devstack sudo[87145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57
Apr 16 19:51:15 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:15 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57" returned: 0 in 0.754s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:15 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57, size 1024.00 MB, duration 3.35 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:51:15 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Converted 1024.00 MB image at 305.51 MB/s
Apr 16 19:51:15 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b is being set with open permissions: ugo+rw
Apr 16 19:51:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:15 devstack sudo[87152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b
Apr 16 19:51:15 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:16 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b" returned: 0 in 0.464s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-c03c819b-2a70-4ee7-833a-aac04513297b" released by "_copy_volume_from_snapshot" :: held 5.850s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-a0195208-e9d1-474d-ba77-006f472971ca-c03c819b-2a70-4ee7-833a-aac04513297b" released by "_create_volume_from_snapshot" :: held 5.881s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.904s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.982s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-714740755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ba4217-cd8b-43b9-abb1-879978b39580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae685b7f6a44a8096fae3b369b9bc47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:10Z,use_quota=True,user_id='735ff61dd7f24820bd203d4c6de1f148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Creating volume 21ba4217-cd8b-43b9-abb1-879978b39580 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:51:16 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21ba4217-cd8b-43b9-abb1-879978b39580 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:16 devstack sudo[87155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21ba4217-cd8b-43b9-abb1-879978b39580 1073741824
Apr 16 19:51:16 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880d303f-5aa9-4e15-aa66-8af2494683a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c03c819b-2a70-4ee7-833a-aac04513297b', 'volume_size': 1, 'snapshot_id': 'a0195208-e9d1-474d-ba77-006f472971ca'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce09ad3-34c3-495c-8919-418ecdb433e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:16 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Volume volume-c03c819b-2a70-4ee7-833a-aac04513297b (c03c819b-2a70-4ee7-833a-aac04513297b): created successfully
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce09ad3-34c3-495c-8919-418ecdb433e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Flow 'volume_create_manager' (8dcf1184-5321-4ee5-8206-af0d5cf38850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:16 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-468a1842-a219-47a4-b054-71300202325b tempest-VolumesDeleteCascade-2077433137 None] Created volume successfully.
Apr 16 19:51:16 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21ba4217-cd8b-43b9-abb1-879978b39580 1073741824" returned: 0 in 0.752s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21ba4217-cd8b-43b9-abb1-879978b39580 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:16 devstack sudo[87160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21ba4217-cd8b-43b9-abb1-879978b39580
Apr 16 19:51:16 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-d7a97d12-85a4-4857-99a7-eae3c8fcda57-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-d7a97d12-85a4-4857-99a7-eae3c8fcda57-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Performing cascade delete. {{(pid=82616) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-a0195208-e9d1-474d-ba77-006f472971ca-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-a0195208-e9d1-474d-ba77-006f472971ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-quobyte-d7a97d12-85a4-4857-99a7-eae3c8fcda57" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-d7a97d12-85a4-4857-99a7-eae3c8fcda57" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-quobyte-a0195208-e9d1-474d-ba77-006f472971ca" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-a0195208-e9d1-474d-ba77-006f472971ca" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Deleting offline snapshot a0195208-e9d1-474d-ba77-006f472971ca of volume d7a97d12-85a4-4857-99a7-eae3c8fcda57 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] snapshot_file for this snap is: volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[15763d17-2d47-43e5-8476-97256a5f0adc]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:17 devstack sudo[87163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca
Apr 16 19:51:17 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:17 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21ba4217-cd8b-43b9-abb1-879978b39580" returned: 0 in 0.506s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.103s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30826ae9-ef6a-4244-a4be-31e409ac766c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7115012ac4d64dabaa2d9a287403b451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:11Z,use_quota=True,user_id='684249f5c8ee4c89a57eb608feb51bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Creating volume 30826ae9-ef6a-4244-a4be-31e409ac766c {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:51:17 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30826ae9-ef6a-4244-a4be-31e409ac766c 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d71b84c-077e-4c5e-af7b-de2f6c4e81f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ba4217-cd8b-43b9-abb1-879978b39580', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92862cf4-d515-435f-ae18-1023887e2afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:17 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Volume volume-21ba4217-cd8b-43b9-abb1-879978b39580 (21ba4217-cd8b-43b9-abb1-879978b39580): created successfully
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92862cf4-d515-435f-ae18-1023887e2afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Flow 'volume_create_manager' (3050d922-dcc2-4c24-a8c7-a7a04e9ce0f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:17 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7c98fee6-1a81-49f5-9f75-413a73272b07 tempest-VolumesTransfersTest-992868795 None] Created volume successfully.
Apr 16 19:51:17 devstack sudo[87165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30826ae9-ef6a-4244-a4be-31e409ac766c 1073741824
Apr 16 19:51:17 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:18 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca" returned: 0 in 0.737s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:51:18 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[351a7646-3e60-40de-b81c-a8a05dd4b9c4]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:18 devstack sudo[87199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57
Apr 16 19:51:18 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:18 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30826ae9-ef6a-4244-a4be-31e409ac766c 1073741824" returned: 0 in 0.955s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30826ae9-ef6a-4244-a4be-31e409ac766c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:18 devstack sudo[87202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30826ae9-ef6a-4244-a4be-31e409ac766c
Apr 16 19:51:18 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:18 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-019a1a6d-12d9-41ff-9891-48bf241942f7 tempest-VolumesTransfersTest-508233299 None] Transfer volume completed successfully.
Apr 16 19:51:18 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57" returned: 0 in 0.828s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:18 devstack sudo[87230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca
Apr 16 19:51:18 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:19 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30826ae9-ef6a-4244-a4be-31e409ac766c" returned: 0 in 0.751s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:51:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14003b1b-e962-4fed-8bba-6aeef3da8c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30826ae9-ef6a-4244-a4be-31e409ac766c', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e8c807-c56e-4108-83d3-dc11d95ab7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:19 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Volume volume-30826ae9-ef6a-4244-a4be-31e409ac766c (30826ae9-ef6a-4244-a4be-31e409ac766c): created successfully
Apr 16 19:51:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e8c807-c56e-4108-83d3-dc11d95ab7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Flow 'volume_create_manager' (fdb6d4e8-2cf0-4da1-8ef5-68a5d5efea33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:19 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-396c7deb-96c6-426d-9e0c-9ff3dffe5b6e tempest-VolumesListAdminTestJSON-1679014684 None] Created volume successfully.
Apr 16 19:51:19 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca" returned: 0 in 0.948s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:19 devstack sudo[87240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca
Apr 16 19:51:19 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:19 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Acquiring lock "cinder-21ba4217-cd8b-43b9-abb1-879978b39580-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:19 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Lock "cinder-21ba4217-cd8b-43b9-abb1-879978b39580-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Acquiring lock "cinder-quobyte-21ba4217-cd8b-43b9-abb1-879978b39580" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Lock "cinder-quobyte-21ba4217-cd8b-43b9-abb1-879978b39580" acquired by "delete_volume" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ee8483-c5c6-49f6-8f24-e656acd44aff]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21ba4217-cd8b-43b9-abb1-879978b39580 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Acquiring lock "cinder-30826ae9-ef6a-4244-a4be-31e409ac766c-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:20 devstack sudo[87243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21ba4217-cd8b-43b9-abb1-879978b39580
Apr 16 19:51:20 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Lock "cinder-30826ae9-ef6a-4244-a4be-31e409ac766c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:UPDATE=117,cinder:INSERT=34,cinder:DELETE=14,cinder:SELECT=112 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Acquiring lock "cinder-quobyte-30826ae9-ef6a-4244-a4be-31e409ac766c" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Lock "cinder-quobyte-30826ae9-ef6a-4244-a4be-31e409ac766c" acquired by "delete_volume" :: waited 0.018s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e27e54b-2543-419b-affa-e9d01a39b465]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30826ae9-ef6a-4244-a4be-31e409ac766c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "cinder-ee563f7e-03ea-43b3-a619-b2ef8799fb04-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Lock "cinder-ee563f7e-03ea-43b3-a619-b2ef8799fb04-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "cinder-quobyte-ee563f7e-03ea-43b3-a619-b2ef8799fb04" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Lock "cinder-quobyte-ee563f7e-03ea-43b3-a619-b2ef8799fb04" acquired by "delete_volume" :: waited 0.037s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:20 devstack sudo[87245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30826ae9-ef6a-4244-a4be-31e409ac766c
Apr 16 19:51:20 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5114433-a311-4537-a8ca-d7cf88f98f23]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:20 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57.a0195208-e9d1-474d-ba77-006f472971ca" returned: 0 in 0.874s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-a0195208-e9d1-474d-ba77-006f472971ca" released by "_delete_snapshot" :: held 3.560s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-d7a97d12-85a4-4857-99a7-eae3c8fcda57" released by "delete_snapshot" :: held 3.574s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Created reservations ['c98a9404-43ee-4015-8339-2ab55834d0a6', 'ea1391ad-7d3f-4313-902f-1e2f5a9abf6e', '3fe8d864-c181-4543-b5bf-6da8d9334ec9', '5e1cde0a-9015-4b5a-b042-76acedf02fd1'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:20 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Delete snapshot completed successfully.
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-a0195208-e9d1-474d-ba77-006f472971ca-delete_snapshot" released by "delete_snapshot" :: held 3.709s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Snapshots deleted, issuing volume delete {{(pid=82616) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 16 19:51:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-quobyte-d7a97d12-85a4-4857-99a7-eae3c8fcda57" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:21 devstack sudo[87248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04
Apr 16 19:51:21 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:21 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-d7a97d12-85a4-4857-99a7-eae3c8fcda57" acquired by "delete_volume" :: waited 0.020s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:21 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:21 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[052599b6-05df-451f-ae60-6f2f5b84e5a0]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21ba4217-cd8b-43b9-abb1-879978b39580" returned: 0 in 1.041s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21ba4217-cd8b-43b9-abb1-879978b39580 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:21 devstack sudo[87254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21ba4217-cd8b-43b9-abb1-879978b39580
Apr 16 19:51:21 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:21 devstack sudo[87253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57
Apr 16 19:51:21 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:21 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Acquiring lock "cinder-a8e3de93-1dbe-4fc0-9507-40e69455de9f-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:21 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Lock "cinder-a8e3de93-1dbe-4fc0-9507-40e69455de9f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:21 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Acquiring lock "cinder-quobyte-a8e3de93-1dbe-4fc0-9507-40e69455de9f" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:21 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Lock "cinder-quobyte-a8e3de93-1dbe-4fc0-9507-40e69455de9f" acquired by "delete_volume" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:21 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4d9dcd-82e8-4621-8d22-8e53d2d9f652]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:21 devstack sudo[87259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f
Apr 16 19:51:21 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:21 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04" returned: 0 in 1.214s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:21 devstack sudo[87265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04
Apr 16 19:51:21 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:22 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30826ae9-ef6a-4244-a4be-31e409ac766c" returned: 0 in 1.639s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30826ae9-ef6a-4244-a4be-31e409ac766c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:22 devstack sudo[87268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30826ae9-ef6a-4244-a4be-31e409ac766c
Apr 16 19:51:22 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:22 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-21ba4217-cd8b-43b9-abb1-879978b39580" returned: 0 in 1.129s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Lock "cinder-quobyte-21ba4217-cd8b-43b9-abb1-879978b39580" released by "delete_volume" :: held 2.254s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Created reservations ['26794807-ed94-43c9-ac51-6372402fae3f', 'becce3e7-b14d-4d4d-804b-adc74f5ba197', '1d979ecc-6e20-4454-85e7-4e7076c580a8', '77557b5a-f900-4b4d-89d0-225417999b8c'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:22 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57" returned: 0 in 1.331s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=117,cinder:INSERT=35,cinder:UPDATE=161,cinder:DELETE=13 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:22 devstack sudo[87273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57
Apr 16 19:51:22 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:22 devstack sudo[87275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:51:22 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:22 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30826ae9-ef6a-4244-a4be-31e409ac766c" returned: 0 in 0.746s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Lock "cinder-quobyte-30826ae9-ef6a-4244-a4be-31e409ac766c" released by "delete_volume" :: held 2.454s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Created reservations ['e399142c-1697-42f2-97ab-9ea5085a43c1', 'ee82a7a8-2db0-499a-bc9f-e333e6c456ff', '7f36fb0c-ef06-41cf-b3c8-8431d36359ff', 'cdf37c58-1e3d-426e-ae13-7e71a0df8f21'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:23 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f" returned: 0 in 1.405s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:23 devstack sudo[87283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:51:23 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:23 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee563f7e-03ea-43b3-a619-b2ef8799fb04" returned: 0 in 1.118s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Lock "cinder-quobyte-ee563f7e-03ea-43b3-a619-b2ef8799fb04" released by "delete_volume" :: held 2.442s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:23 devstack sudo[87284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f
Apr 16 19:51:23 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Created reservations ['89cb2bac-6b86-4107-b1f2-c9d76d378fee', '1b7f6cc7-2929-4968-a857-aa6c66104df8', '79d6f88e-73c9-4f58-af14-dbb32a62e454', '3c22e8d9-8a1b-47d3-b5f3-c2347d11362f'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:23 devstack sudo[87287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:51:23 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:23 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.903s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:51:23 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Deleted volume successfully.
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-79d1b47e-e38f-4b31-b3b9-925c1e221692 tempest-VolumesTransfersTest-1095692183 None] Lock "cinder-21ba4217-cd8b-43b9-abb1-879978b39580-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:23 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d7a97d12-85a4-4857-99a7-eae3c8fcda57" returned: 0 in 1.318s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-d7a97d12-85a4-4857-99a7-eae3c8fcda57" released by "delete_volume" :: held 2.883s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:23 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Created reservations ['a31ab6e5-13f4-43b9-a1bd-f0d77e356ce9', '4158d678-f454-4602-830a-4e553d9e4219', '8c050620-c753-41bb-9b7b-8b34e9017c83', '2863e021-6895-4af5-90e5-8caa7d6afcf3'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:24 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "cinder-04b15b0b-7cb1-42e7-94fd-de7289527668-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.956s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:51:24 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Deleted volume successfully.
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Lock "cinder-04b15b0b-7cb1-42e7-94fd-de7289527668-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40a48e6c-0db4-41f9-b8f8-67105a37d8aa tempest-VolumesListAdminTestJSON-288370461 None] Lock "cinder-ee563f7e-03ea-43b3-a619-b2ef8799fb04-delete_volume" released by "delete_volume" :: held 3.800s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "cinder-quobyte-04b15b0b-7cb1-42e7-94fd-de7289527668" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Lock "cinder-quobyte-04b15b0b-7cb1-42e7-94fd-de7289527668" acquired by "delete_volume" :: waited 0.028s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:24 devstack sudo[87295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:51:24 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:51:24 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:24 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Flow 'volume_create_manager' (84d995cb-082c-48a2-bf8c-f064b93335b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8493028-a396-4b26-bea7-40068902fdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2faab6-d804-4482-8c9c-ddaacf9cc329]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04b15b0b-7cb1-42e7-94fd-de7289527668 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-c03c819b-2a70-4ee7-833a-aac04513297b-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 1.548s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a8e3de93-1dbe-4fc0-9507-40e69455de9f" returned: 0 in 1.526s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8493028-a396-4b26-bea7-40068902fdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2113761416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c12733-769b-42b1-8c27-7ce0fcb190bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae685b7f6a44a8096fae3b369b9bc47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:24Z,use_quota=True,user_id='735ff61dd7f24820bd203d4c6de1f148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b817f9ca-17e5-480c-8467-e47730dfa071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b817f9ca-17e5-480c-8467-e47730dfa071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9239e2d2-7674-4691-9cd9-2ec0d711d396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9239e2d2-7674-4691-9cd9-2ec0d711d396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0c12733-769b-42b1-8c27-7ce0fcb190bd', 'volume_name': 'volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f48c63-e99e-4861-90dd-aa1bda39d41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f48c63-e99e-4861-90dd-aa1bda39d41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a95778d-2d6a-445b-8cb0-95c65b5e75d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:24 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Volume e0c12733-769b-42b1-8c27-7ce0fcb190bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd', 'volume_size': 1}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:24 devstack sudo[87297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04b15b0b-7cb1-42e7-94fd-de7289527668
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2113761416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c12733-769b-42b1-8c27-7ce0fcb190bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae685b7f6a44a8096fae3b369b9bc47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:24Z,use_quota=True,user_id='735ff61dd7f24820bd203d4c6de1f148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Creating volume e0c12733-769b-42b1-8c27-7ce0fcb190bd {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:51:24 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:51:24 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:24 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Deleted volume successfully.
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Lock "cinder-quobyte-a8e3de93-1dbe-4fc0-9507-40e69455de9f" released by "delete_volume" :: held 3.133s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-c03c819b-2a70-4ee7-833a-aac04513297b-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:24 devstack sudo[87301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd 1073741824
Apr 16 19:51:24 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-13e1917f-88b8-4c74-97ff-635a93038ca0 tempest-VolumesListAdminTestJSON-1679014684 None] Lock "cinder-30826ae9-ef6a-4244-a4be-31e409ac766c-delete_volume" released by "delete_volume" :: held 4.359s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "cinder-quobyte-c03c819b-2a70-4ee7-833a-aac04513297b" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-c03c819b-2a70-4ee7-833a-aac04513297b" acquired by "delete_volume" :: waited 0.022s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa1e131-b11e-46dc-8913-b7860bbbd963]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:24 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Created reservations ['6131e964-d551-4ba7-abd4-7bb5dcfbe0b6', '65c4bd16-56ab-4bbc-8e4e-93f36bb6962b', 'bc57aee7-b362-4a67-bd1a-cd7f98a8f739', 'c586bb5a-8dea-44ea-b592-9733556d7401'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:25 devstack sudo[87307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b
Apr 16 19:51:25 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:25 devstack sudo[87334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:51:25 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:25 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 1.031s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:25 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:51:25 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Deleted volume successfully.
Apr 16 19:51:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c2e704-a7bf-400f-ba47-403127137c01 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-d7a97d12-85a4-4857-99a7-eae3c8fcda57-delete_volume" released by "delete_volume" :: held 8.160s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:25 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04b15b0b-7cb1-42e7-94fd-de7289527668" returned: 0 in 1.198s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04b15b0b-7cb1-42e7-94fd-de7289527668 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:25 devstack sudo[87343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04b15b0b-7cb1-42e7-94fd-de7289527668
Apr 16 19:51:25 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:25 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd 1073741824" returned: 0 in 1.356s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:26 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b" returned: 0 in 1.196s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:26 devstack sudo[87349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd
Apr 16 19:51:26 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:26 devstack sudo[87350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b
Apr 16 19:51:26 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:26 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 1.077s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:51:26 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Deleted volume successfully.
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c5c1d672-09a3-4746-83da-2318f92bd185 tempest-ServerRescueNegativeTestJSON-1254920346 None] Lock "cinder-a8e3de93-1dbe-4fc0-9507-40e69455de9f-delete_volume" released by "delete_volume" :: held 4.725s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:26 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04b15b0b-7cb1-42e7-94fd-de7289527668" returned: 0 in 0.752s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Lock "cinder-quobyte-04b15b0b-7cb1-42e7-94fd-de7289527668" released by "delete_volume" :: held 2.109s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Created reservations ['0cb61f64-0237-4e01-9021-0824bb55d15d', '26440416-48ea-4e68-b3de-59c125bc3d54', '8b1987e0-c1af-4cc3-ab19-f8c3c2724cf3', '1eb13b5f-8caf-4a49-9051-f7448e323ac0'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:26 devstack sudo[87355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:51:26 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:26 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd" returned: 0 in 0.881s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] <== create_volume: return (2272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.274s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a95778d-2d6a-445b-8cb0-95c65b5e75d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abd28bb-4962-40c9-8234-2ef64546a238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:26 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Volume volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd (e0c12733-769b-42b1-8c27-7ce0fcb190bd): created successfully
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abd28bb-4962-40c9-8234-2ef64546a238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Flow 'volume_create_manager' (84d995cb-082c-48a2-bf8c-f064b93335b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:26 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-08dc8e29-3005-4d5b-88dc-c493efc20c67 tempest-VolumesTransfersTest-992868795 None] Created volume successfully.
Apr 16 19:51:27 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c03c819b-2a70-4ee7-833a-aac04513297b" returned: 0 in 1.018s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-quobyte-c03c819b-2a70-4ee7-833a-aac04513297b" released by "delete_volume" :: held 2.301s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Created reservations ['d82e88cd-d380-4146-bbee-290ab15297bf', '0b5d0e14-f2db-4803-b16d-14fbb3f91e1e', 'cc937ae4-e644-47a0-90aa-14c21dd65014', 'e919ac78-08f1-4896-80c2-c1f84fb70386'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:27 devstack sudo[87360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:51:27 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:27 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.618s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:51:27 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Deleted volume successfully.
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef967ade-28fe-4d43-b0cb-5c0219995cd2 tempest-VolumesListAdminTestJSON-288370461 None] Lock "cinder-04b15b0b-7cb1-42e7-94fd-de7289527668-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:27 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.583s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:51:27 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Deleted volume successfully.
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-35bef965-42f0-4b3f-831f-bcb0615b6be4 tempest-VolumesDeleteCascade-2077433137 None] Lock "cinder-c03c819b-2a70-4ee7-833a-aac04513297b-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "cinder-f9e70cf2-75cb-431e-9038-0b595e0e6336-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Lock "cinder-f9e70cf2-75cb-431e-9038-0b595e0e6336-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "cinder-quobyte-f9e70cf2-75cb-431e-9038-0b595e0e6336" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Lock "cinder-quobyte-f9e70cf2-75cb-431e-9038-0b595e0e6336" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee1b40b-2d2e-4b57-8de9-7aea94beff4a]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f9e70cf2-75cb-431e-9038-0b595e0e6336 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Acquiring lock "cinder-e0c12733-769b-42b1-8c27-7ce0fcb190bd-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Lock "cinder-e0c12733-769b-42b1-8c27-7ce0fcb190bd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Acquiring lock "cinder-quobyte-e0c12733-769b-42b1-8c27-7ce0fcb190bd" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Lock "cinder-quobyte-e0c12733-769b-42b1-8c27-7ce0fcb190bd" acquired by "delete_volume" :: waited 0.038s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:28 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b798df0d-d873-42c2-982f-a6b998c35fa0]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:28 devstack sudo[87389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f9e70cf2-75cb-431e-9038-0b595e0e6336
Apr 16 19:51:28 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:28 devstack sudo[87390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd
Apr 16 19:51:28 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:28 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f9e70cf2-75cb-431e-9038-0b595e0e6336" returned: 0 in 0.836s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f9e70cf2-75cb-431e-9038-0b595e0e6336 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:28 devstack sudo[87400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f9e70cf2-75cb-431e-9038-0b595e0e6336
Apr 16 19:51:28 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:28 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd" returned: 0 in 0.731s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:28 devstack sudo[87402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd
Apr 16 19:51:28 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:29 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f9e70cf2-75cb-431e-9038-0b595e0e6336" returned: 0 in 0.648s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Lock "cinder-quobyte-f9e70cf2-75cb-431e-9038-0b595e0e6336" released by "delete_volume" :: held 1.523s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Created reservations ['975dd95d-12b6-4ed7-90bd-9ee83095fec1', '8d5ba409-10d9-4f75-a951-deb0ead490d6', '463bff93-8bfe-4703-b34e-4ba48edb341b', '5c64b684-a7e7-4752-8444-524b75ff7a0c'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:29 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e0c12733-769b-42b1-8c27-7ce0fcb190bd" returned: 0 in 0.658s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Lock "cinder-quobyte-e0c12733-769b-42b1-8c27-7ce0fcb190bd" released by "delete_volume" :: held 1.414s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Created reservations ['f3afa2a2-6396-44b2-bfb6-b860adca79d4', 'e719317d-e076-4324-9012-7e9d769a547c', '77d323a9-79ad-4753-b9d7-9a0aba1fc719', 'a61171b8-1fe2-4d9a-9fa8-b63b8f379894'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:29 devstack sudo[87407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:51:29 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:29 devstack sudo[87409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:51:29 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:30 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.670s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:30 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:51:30 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Deleted volume successfully.
Apr 16 19:51:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2619a60d-1059-44a9-b1e1-83c75c7f6336 tempest-VolumesListAdminTestJSON-288370461 None] Lock "cinder-f9e70cf2-75cb-431e-9038-0b595e0e6336-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:30 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.646s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:30 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:51:30 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Deleted volume successfully.
Apr 16 19:51:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8b3fc259-aea0-46bf-ab6b-5f21562cffb0 tempest-VolumesTransfersTest-1095692183 None] Lock "cinder-e0c12733-769b-42b1-8c27-7ce0fcb190bd-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Flow 'volume_create_manager' (c0ac348a-e026-4b50-beb1-9738ce28ae54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4710e46-abc3-4300-b72e-2a4ddb9c5924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4710e46-abc3-4300-b72e-2a4ddb9c5924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-251794986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca68825-dbab-4b11-b3e1-a85f8d3a5d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6d4c507d2b48f4bc297ef4eed52ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:33Z,use_quota=True,user_id='f455cccfc20b42f1b020716bd2ec2a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b61f52-3e0c-4155-b7f2-255b2a6a6071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b61f52-3e0c-4155-b7f2-255b2a6a6071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2e767d-81af-4c4b-ab04-b5247de8e1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2e767d-81af-4c4b-ab04-b5247de8e1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca68825-dbab-4b11-b3e1-a85f8d3a5d71', 'volume_name': 'volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bceeec2-8641-4655-a19a-6ab9429242cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bceeec2-8641-4655-a19a-6ab9429242cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2293582-109e-4f66-ae49-4139fd3e70df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:32 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Volume 8ca68825-dbab-4b11-b3e1-a85f8d3a5d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71', 'volume_size': 1}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-251794986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca68825-dbab-4b11-b3e1-a85f8d3a5d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6d4c507d2b48f4bc297ef4eed52ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:33Z,use_quota=True,user_id='f455cccfc20b42f1b020716bd2ec2a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Creating volume 8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:51:32 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:51:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:32 devstack sudo[87420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 1073741824
Apr 16 19:51:32 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:33 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 1073741824" returned: 0 in 1.022s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:33 devstack sudo[87426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71
Apr 16 19:51:33 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:34 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" returned: 0 in 0.792s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:51:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2293582-109e-4f66-ae49-4139fd3e70df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56865de-f7e6-4d1b-906a-58608449c98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:34 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Volume volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 (8ca68825-dbab-4b11-b3e1-a85f8d3a5d71): created successfully
Apr 16 19:51:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56865de-f7e6-4d1b-906a-58608449c98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Flow 'volume_create_manager' (c0ac348a-e026-4b50-beb1-9738ce28ae54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:34 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-d8fa82fe-e2b0-4099-9be3-719ca0ea0cc8 tempest-VolumesSnapshotListTestJSON-1668616572 None] Created volume successfully.
Apr 16 19:51:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] Creating offline snapshot 2879aeb0-0394-4bf0-a2aa-90026eae0ebb of volume 8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:51:35 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a37988d-a4bd-415d-b43a-29bc2ee82f94]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:35 devstack sudo[87456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71
Apr 16 19:51:35 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:35 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" returned: 0 in 0.700s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:35 devstack sudo[87463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb 1G
Apr 16 19:51:35 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Flow 'volume_create_manager' (5e636514-3300-47b6-a8dd-3a5d4e278021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab58d60-43b3-4c62-9d95-416d4a6e999f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab58d60-43b3-4c62-9d95-416d4a6e999f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-978352506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a204866e-cf9b-4e5d-997c-a2e14df88357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3815ba407a7e4179a8c1791a90c2e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:36Z,use_quota=True,user_id='da1f0de17161499f903d06e8c52c2026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c89105-fedc-4d8e-be69-27644fd0dfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c89105-fedc-4d8e-be69-27644fd0dfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cc734b-a319-4597-b1b6-ea5373a45812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cc734b-a319-4597-b1b6-ea5373a45812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a204866e-cf9b-4e5d-997c-a2e14df88357', 'volume_name': 'volume-a204866e-cf9b-4e5d-997c-a2e14df88357', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd86a90-20c8-4378-b5cd-4617c3af1de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd86a90-20c8-4378-b5cd-4617c3af1de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536a7569-6d56-46d7-82b9-15488cf11430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:36 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Volume a204866e-cf9b-4e5d-997c-a2e14df88357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a204866e-cf9b-4e5d-997c-a2e14df88357', 'volume_size': 1}
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:36 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb 1G" returned: 0 in 0.734s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:36 devstack sudo[87470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb
Apr 16 19:51:36 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:36 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb" returned: 0 in 0.512s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:36 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb is being set with open permissions: ugo+rw
Apr 16 19:51:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:37 devstack sudo[87475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb
Apr 16 19:51:37 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:37 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb" returned: 0 in 0.516s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:37 devstack sudo[87478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.info
Apr 16 19:51:37 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:38 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.info" returned: 0 in 0.564s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:38 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.info is being set with open permissions: ugo+rw
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:38 devstack sudo[87481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.info
Apr 16 19:51:38 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:38 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.info" returned: 0 in 0.512s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.615s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.221s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-978352506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a204866e-cf9b-4e5d-997c-a2e14df88357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3815ba407a7e4179a8c1791a90c2e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:36Z,use_quota=True,user_id='da1f0de17161499f903d06e8c52c2026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Creating volume a204866e-cf9b-4e5d-997c-a2e14df88357 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:51:38 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:51:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a204866e-cf9b-4e5d-997c-a2e14df88357 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:38 devstack sudo[87484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a204866e-cf9b-4e5d-997c-a2e14df88357 1073741824
Apr 16 19:51:38 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:38 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-45b56946-73a9-4d4e-959d-4270c8b21c41 tempest-VolumesSnapshotListTestJSON-1668616572 None] Create snapshot completed successfully
Apr 16 19:51:39 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a204866e-cf9b-4e5d-997c-a2e14df88357 1073741824" returned: 0 in 0.652s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a204866e-cf9b-4e5d-997c-a2e14df88357 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:39 devstack sudo[87489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a204866e-cf9b-4e5d-997c-a2e14df88357
Apr 16 19:51:39 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:39 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a204866e-cf9b-4e5d-997c-a2e14df88357" returned: 0 in 0.516s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.461s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536a7569-6d56-46d7-82b9-15488cf11430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a204866e-cf9b-4e5d-997c-a2e14df88357', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db05769-8e0b-4106-94c6-24c74afc4696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] Creating offline snapshot 4e132a0c-c550-4cc0-abf8-d066aea49188 of volume 8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:51:39 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Volume volume-a204866e-cf9b-4e5d-997c-a2e14df88357 (a204866e-cf9b-4e5d-997c-a2e14df88357): created successfully
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db05769-8e0b-4106-94c6-24c74afc4696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Flow 'volume_create_manager' (5e636514-3300-47b6-a8dd-3a5d4e278021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb3f3b2-4e7c-444b-81dc-025f08cd864d]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:39 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-eac1ec73-1978-4fc3-b260-77f630de03fb tempest-VolumesMetadataTest-1277439196 None] Created volume successfully.
Apr 16 19:51:40 devstack sudo[87492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb
Apr 16 19:51:40 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:40 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb" returned: 0 in 0.742s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:40 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:51:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:40 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 1G
Apr 16 19:51:40 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:41 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Acquiring lock "cinder-a204866e-cf9b-4e5d-997c-a2e14df88357-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:41 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Lock "cinder-a204866e-cf9b-4e5d-997c-a2e14df88357-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:41 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 1G" returned: 0 in 0.724s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:41 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Acquiring lock "cinder-quobyte-a204866e-cf9b-4e5d-997c-a2e14df88357" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:41 devstack sudo[87502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188
Apr 16 19:51:41 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:41 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Lock "cinder-quobyte-a204866e-cf9b-4e5d-997c-a2e14df88357" acquired by "delete_volume" :: waited 0.019s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:41 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b5fd7d-95ee-4c06-bfd7-f728843f26f2]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a204866e-cf9b-4e5d-997c-a2e14df88357 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:41 devstack sudo[87504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a204866e-cf9b-4e5d-997c-a2e14df88357
Apr 16 19:51:41 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:42 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188" returned: 0 in 0.710s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:42 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 is being set with open permissions: ugo+rw
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:42 devstack sudo[87512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188
Apr 16 19:51:42 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:42 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a204866e-cf9b-4e5d-997c-a2e14df88357" returned: 0 in 0.702s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a204866e-cf9b-4e5d-997c-a2e14df88357 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:42 devstack sudo[87514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a204866e-cf9b-4e5d-997c-a2e14df88357
Apr 16 19:51:42 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:51:42 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Flow 'volume_create_manager' (af8d3858-9923-4d82-8ebf-511a06613ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144754d3-8748-49b2-9936-a3e04b1edf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:42 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188" returned: 0 in 0.714s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a204866e-cf9b-4e5d-997c-a2e14df88357" returned: 0 in 0.625s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144754d3-8748-49b2-9936-a3e04b1edf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-394368429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d11e7bf-3d3f-467c-9f62-99961cc75599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c199e8e5e83452696a32b3567b9d6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:43Z,use_quota=True,user_id='4a04ac6e711249ac8715dad09bf27756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8caa11a6-515e-48aa-9272-34685aed2927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8caa11a6-515e-48aa-9272-34685aed2927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686c3bea-aa75-41bf-bc23-22db4e6558c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686c3bea-aa75-41bf-bc23-22db4e6558c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d11e7bf-3d3f-467c-9f62-99961cc75599', 'volume_name': 'volume-4d11e7bf-3d3f-467c-9f62-99961cc75599', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f515066-9ed0-4fed-b123-3402ee8bcdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f515066-9ed0-4fed-b123-3402ee8bcdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d13802-df6c-4eca-b7a7-94e69bf9b1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:42 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Volume 4d11e7bf-3d3f-467c-9f62-99961cc75599: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d11e7bf-3d3f-467c-9f62-99961cc75599', 'volume_size': 1}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Lock "cinder-quobyte-a204866e-cf9b-4e5d-997c-a2e14df88357" released by "delete_volume" :: held 1.404s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.033s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-394368429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d11e7bf-3d3f-467c-9f62-99961cc75599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c199e8e5e83452696a32b3567b9d6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:43Z,use_quota=True,user_id='4a04ac6e711249ac8715dad09bf27756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Creating volume 4d11e7bf-3d3f-467c-9f62-99961cc75599 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:51:42 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:42 devstack sudo[87519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 1073741824
Apr 16 19:51:42 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:42 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-dce99187-78f6-43f5-a741-123078088f28 tempest-VolumesSnapshotListTestJSON-1668616572 None] Create snapshot completed successfully
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Created reservations ['15f4ccaa-264c-41cb-b706-1b83708a339e', '3cd7150a-cd70-4677-977d-9b3eff719415', 'ea02d8fd-4edf-4a6a-8370-690dc75314b4', 'b7dad4e4-45f7-48c5-ab3e-f71a9b46bd0b'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:43 devstack sudo[87521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:51:43 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:43 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.525s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:43 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:51:43 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Deleted volume successfully.
Apr 16 19:51:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-497661f8-6f23-462f-9fd4-8be4dc6cef37 tempest-VolumesMetadataTest-1277439196 None] Lock "cinder-a204866e-cf9b-4e5d-997c-a2e14df88357-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:43 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 1073741824" returned: 0 in 0.666s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:43 devstack sudo[87527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599
Apr 16 19:51:43 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:44 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599" returned: 0 in 0.555s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.375s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d13802-df6c-4eca-b7a7-94e69bf9b1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d11e7bf-3d3f-467c-9f62-99961cc75599', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825d3d0b-ed4e-47f3-bd61-31d0ac51f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] Creating offline snapshot 58fe7e33-febb-4e45-bc1e-9e4151fdfa7c of volume 8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:51:44 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Volume volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 (4d11e7bf-3d3f-467c-9f62-99961cc75599): created successfully
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825d3d0b-ed4e-47f3-bd61-31d0ac51f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Flow 'volume_create_manager' (af8d3858-9923-4d82-8ebf-511a06613ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[378b1518-a2ed-4194-bd3c-ccbeced295a3]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:44 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-259860d2-3b27-4283-8f74-22ff9a2a0ba6 tempest-VolumesActionsTest-1478275988 None] Created volume successfully.
Apr 16 19:51:44 devstack sudo[87530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188
Apr 16 19:51:44 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:44 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188" returned: 0 in 0.625s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:51:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:44 devstack sudo[87537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c 1G
Apr 16 19:51:44 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:45 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c 1G" returned: 0 in 0.727s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:45 devstack sudo[87542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c
Apr 16 19:51:45 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:46 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c" returned: 0 in 0.772s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:46 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c is being set with open permissions: ugo+rw
Apr 16 19:51:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:46 devstack sudo[87550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c
Apr 16 19:51:46 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:46 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c" returned: 0 in 0.591s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.818s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:46 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-4e9be231-592e-4399-9e19-b90c4bd08905 tempest-VolumesSnapshotListTestJSON-1668616572 None] Create snapshot completed successfully
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Flow 'volume_create_manager' (ff7871cf-0080-4763-9c0c-ae4151ecef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2011bca8-2538-4f17-984d-b2798b6ea39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2011bca8-2538-4f17-984d-b2798b6ea39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1472406868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df54b0eb-9624-43f0-b929-875d5b362b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a2afcb99b054d82a4f47ae076e1586e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:47Z,use_quota=True,user_id='d15c86b153a443b2a199c25c1ce66b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa09102-80e5-469b-8605-fda87f2d451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa09102-80e5-469b-8605-fda87f2d451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9d3081-e211-4ed1-80db-b4966f44205f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9d3081-e211-4ed1-80db-b4966f44205f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df54b0eb-9624-43f0-b929-875d5b362b3a', 'volume_name': 'volume-df54b0eb-9624-43f0-b929-875d5b362b3a', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea466348-60d9-4925-aff8-1df5e2f7985a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea466348-60d9-4925-aff8-1df5e2f7985a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393fff10-1548-46cf-b2c3-92863f4f1413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:47 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Volume df54b0eb-9624-43f0-b929-875d5b362b3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df54b0eb-9624-43f0-b929-875d5b362b3a', 'volume_size': 1}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1472406868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df54b0eb-9624-43f0-b929-875d5b362b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a2afcb99b054d82a4f47ae076e1586e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:47Z,use_quota=True,user_id='d15c86b153a443b2a199c25c1ce66b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Creating volume df54b0eb-9624-43f0-b929-875d5b362b3a {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:51:47 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:51:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-df54b0eb-9624-43f0-b929-875d5b362b3a 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:47 devstack sudo[87555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-df54b0eb-9624-43f0-b929-875d5b362b3a 1073741824
Apr 16 19:51:47 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:48 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-df54b0eb-9624-43f0-b929-875d5b362b3a 1073741824" returned: 0 in 0.688s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-df54b0eb-9624-43f0-b929-875d5b362b3a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:48 devstack sudo[87560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-df54b0eb-9624-43f0-b929-875d5b362b3a
Apr 16 19:51:48 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:48 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-df54b0eb-9624-43f0-b929-875d5b362b3a" returned: 0 in 0.535s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393fff10-1548-46cf-b2c3-92863f4f1413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df54b0eb-9624-43f0-b929-875d5b362b3a', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55b7b35-fef5-47e1-bf48-a01d1bc48288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:48 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Volume volume-df54b0eb-9624-43f0-b929-875d5b362b3a (df54b0eb-9624-43f0-b929-875d5b362b3a): created successfully
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55b7b35-fef5-47e1-bf48-a01d1bc48288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Flow 'volume_create_manager' (ff7871cf-0080-4763-9c0c-ae4151ecef5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:48 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-810addbf-b4ba-45ed-ab55-8572762006b6 tempest-VolumesTransfersV357Test-750235829 None] Created volume successfully.
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "cinder-58fe7e33-febb-4e45-bc1e-9e4151fdfa7c-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-58fe7e33-febb-4e45-bc1e-9e4151fdfa7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "cinder-quobyte-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "cinder-quobyte-58fe7e33-febb-4e45-bc1e-9e4151fdfa7c" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-58fe7e33-febb-4e45-bc1e-9e4151fdfa7c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Deleting offline snapshot 58fe7e33-febb-4e45-bc1e-9e4151fdfa7c of volume 8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] snapshot_file for this snap is: volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7266bfae-4f6e-40fe-b294-965a3c433bc0]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:48 devstack sudo[87563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c
Apr 16 19:51:48 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:49 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c" returned: 0 in 0.596s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:51:49 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a60f354-174d-42a1-bf17-0c1305540e50]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:49 devstack sudo[87568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188
Apr 16 19:51:49 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:49 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-30441778-9e83-48c5-96ef-d0df46a64d65 tempest-VolumesTransfersV357Test-1573684921 None] Transfer volume completed successfully.
Apr 16 19:51:49 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188" returned: 0 in 0.494s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:51:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:50 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c
Apr 16 19:51:50 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4cae36c5-8b46-46bc-9c94-3a882cb10c56 tempest-BackendsCapabilitiesAdminTestsJSON-423121740 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5437622070312, 'free_capacity_gb': 1775.5437622070312, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82616) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 16 19:51:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-92b27150-cf57-4a6e-97b7-ee8e9cda5ced tempest-BackendsCapabilitiesAdminTestsJSON-423121740 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5437622070312, 'free_capacity_gb': 1775.5437622070312, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82616) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 16 19:51:50 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c" returned: 0 in 0.650s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:50 devstack sudo[87578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c
Apr 16 19:51:50 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Acquiring lock "cinder-df54b0eb-9624-43f0-b929-875d5b362b3a-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Lock "cinder-df54b0eb-9624-43f0-b929-875d5b362b3a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Acquiring lock "cinder-quobyte-df54b0eb-9624-43f0-b929-875d5b362b3a" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Lock "cinder-quobyte-df54b0eb-9624-43f0-b929-875d5b362b3a" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:50 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[11affbbd-49f5-4162-b004-f7e1dece89ae]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-df54b0eb-9624-43f0-b929-875d5b362b3a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:51 devstack sudo[87580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-df54b0eb-9624-43f0-b929-875d5b362b3a
Apr 16 19:51:51 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:51 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.58fe7e33-febb-4e45-bc1e-9e4151fdfa7c" returned: 0 in 0.648s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-58fe7e33-febb-4e45-bc1e-9e4151fdfa7c" released by "_delete_snapshot" :: held 2.454s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" released by "delete_snapshot" :: held 2.470s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:51 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Created reservations ['ea0355b6-ee33-4826-8989-81df307fcab5', 'eabc3d47-a40b-41e1-a90a-81dcc5645b3e', '51453d24-06b7-48ab-b1f8-5f904f3c3c61', '861f22ad-15cf-4aa1-b69c-df60d0158544'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:51 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Delete snapshot completed successfully.
Apr 16 19:51:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a30818d-2186-483c-a1ef-3c17134184de tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-58fe7e33-febb-4e45-bc1e-9e4151fdfa7c-delete_snapshot" released by "delete_snapshot" :: held 2.575s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:51 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-df54b0eb-9624-43f0-b929-875d5b362b3a" returned: 0 in 0.617s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-df54b0eb-9624-43f0-b929-875d5b362b3a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:51 devstack sudo[87586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-df54b0eb-9624-43f0-b929-875d5b362b3a
Apr 16 19:51:51 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:52 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-df54b0eb-9624-43f0-b929-875d5b362b3a" returned: 0 in 0.535s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Lock "cinder-quobyte-df54b0eb-9624-43f0-b929-875d5b362b3a" released by "delete_volume" :: held 1.191s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Created reservations ['0a4f725d-fc84-41b4-84be-d55b1683fbc7', '033dd4e9-eb50-4d13-b99c-8cbd6cd0e3aa', '0e7c09fa-2b2a-49a0-9e56-27aedb931cde', 'b9e973c5-9223-4c4f-9bae-e6ba9d510736'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "cinder-4e132a0c-c550-4cc0-abf8-d066aea49188-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:52 devstack sudo[87589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:51:52 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-4e132a0c-c550-4cc0-abf8-d066aea49188-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "cinder-quobyte-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "cinder-quobyte-4e132a0c-c550-4cc0-abf8-d066aea49188" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-4e132a0c-c550-4cc0-abf8-d066aea49188" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Deleting offline snapshot 4e132a0c-c550-4cc0-abf8-d066aea49188 of volume 8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] snapshot_file for this snap is: volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4fc96f-c569-4052-afdf-ee317cecd6b6]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:52 devstack sudo[87591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188
Apr 16 19:51:52 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:52 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.523s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:51:52 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Deleted volume successfully.
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dbd28adb-ed32-4f71-84fe-5fb3c0505723 tempest-VolumesTransfersV357Test-1740682446 None] Lock "cinder-df54b0eb-9624-43f0-b929-875d5b362b3a-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:52 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188" returned: 0 in 0.600s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b39387-fd7f-4912-ae52-9f1417f5660c]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:53 devstack sudo[87602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb
Apr 16 19:51:53 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Flow 'volume_create_manager' (39de72c4-6eda-4ed7-957a-7e57974b685c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb74a29-52e9-422e-aef3-98100802a535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb74a29-52e9-422e-aef3-98100802a535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-873934651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e541f8-1288-4f15-b493-ed17cecd7b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a2afcb99b054d82a4f47ae076e1586e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:53Z,use_quota=True,user_id='d15c86b153a443b2a199c25c1ce66b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3986a5-b72d-491c-bbef-c2e39899e754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3986a5-b72d-491c-bbef-c2e39899e754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182fa39e-7795-4aea-af16-689ad339f6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182fa39e-7795-4aea-af16-689ad339f6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e541f8-1288-4f15-b493-ed17cecd7b90', 'volume_name': 'volume-15e541f8-1288-4f15-b493-ed17cecd7b90', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de511cc-b183-4461-b40d-ca4c15297003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de511cc-b183-4461-b40d-ca4c15297003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c15c2b5-5dbb-4545-bb6a-edb3b8e4d214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:53 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Volume 15e541f8-1288-4f15-b493-ed17cecd7b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e541f8-1288-4f15-b493-ed17cecd7b90', 'volume_size': 1}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-873934651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e541f8-1288-4f15-b493-ed17cecd7b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a2afcb99b054d82a4f47ae076e1586e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:53Z,use_quota=True,user_id='d15c86b153a443b2a199c25c1ce66b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Creating volume 15e541f8-1288-4f15-b493-ed17cecd7b90 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:51:53 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-15e541f8-1288-4f15-b493-ed17cecd7b90 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:53 devstack sudo[87618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-15e541f8-1288-4f15-b493-ed17cecd7b90 1073741824
Apr 16 19:51:53 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:53 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb" returned: 0 in 0.667s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:51:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:53 devstack sudo[87620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188
Apr 16 19:51:53 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:54 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188" returned: 0 in 0.566s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:54 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-15e541f8-1288-4f15-b493-ed17cecd7b90 1073741824" returned: 0 in 0.656s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:54 devstack sudo[87628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188
Apr 16 19:51:54 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-15e541f8-1288-4f15-b493-ed17cecd7b90 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:54 devstack sudo[87630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-15e541f8-1288-4f15-b493-ed17cecd7b90
Apr 16 19:51:54 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:54 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.4e132a0c-c550-4cc0-abf8-d066aea49188" returned: 0 in 0.551s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-4e132a0c-c550-4cc0-abf8-d066aea49188" released by "_delete_snapshot" :: held 2.454s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" released by "delete_snapshot" :: held 2.468s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:54 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-15e541f8-1288-4f15-b493-ed17cecd7b90" returned: 0 in 0.558s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c15c2b5-5dbb-4545-bb6a-edb3b8e4d214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e541f8-1288-4f15-b493-ed17cecd7b90', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9435c9-73fe-44bb-8a01-13932bf02185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:54 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Volume volume-15e541f8-1288-4f15-b493-ed17cecd7b90 (15e541f8-1288-4f15-b493-ed17cecd7b90): created successfully
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9435c9-73fe-44bb-8a01-13932bf02185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Flow 'volume_create_manager' (39de72c4-6eda-4ed7-957a-7e57974b685c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Created reservations ['43969786-6052-47cc-93a5-8d47949a4981', 'ae7e7242-ba50-465e-bc1b-703d05238136', '7d66e46b-fef4-4f41-a9eb-d84faa6b6de3', '0abb2ec2-8f96-444c-a6a7-00ff10c53759'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:54 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-b0eb70c2-7e93-4a28-b796-7228b38e4e6a tempest-VolumesTransfersV357Test-750235829 None] Created volume successfully.
Apr 16 19:51:54 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Delete snapshot completed successfully.
Apr 16 19:51:54 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8c009bc4-e66e-4dd1-97f7-8b8a7da761e7 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-4e132a0c-c550-4cc0-abf8-d066aea49188-delete_snapshot" released by "delete_snapshot" :: held 2.618s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "cinder-2879aeb0-0394-4bf0-a2aa-90026eae0ebb-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-2879aeb0-0394-4bf0-a2aa-90026eae0ebb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "cinder-quobyte-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "cinder-quobyte-2879aeb0-0394-4bf0-a2aa-90026eae0ebb" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-2879aeb0-0394-4bf0-a2aa-90026eae0ebb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Deleting offline snapshot 2879aeb0-0394-4bf0-a2aa-90026eae0ebb of volume 8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] snapshot_file for this snap is: volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00201c0-cbcf-4289-b7d3-8ee98095d4f7]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:55 devstack sudo[87635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb
Apr 16 19:51:55 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Acquiring lock "cinder-15e541f8-1288-4f15-b493-ed17cecd7b90-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Lock "cinder-15e541f8-1288-4f15-b493-ed17cecd7b90-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Acquiring lock "cinder-quobyte-15e541f8-1288-4f15-b493-ed17cecd7b90" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Lock "cinder-quobyte-15e541f8-1288-4f15-b493-ed17cecd7b90" acquired by "delete_volume" :: waited 0.022s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6018eed-a0e6-4198-96a6-ece22196425e]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-15e541f8-1288-4f15-b493-ed17cecd7b90 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:56 devstack sudo[87637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-15e541f8-1288-4f15-b493-ed17cecd7b90
Apr 16 19:51:56 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:56 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb" returned: 0 in 0.634s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:56 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:51:56 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ccf5ff-b994-44be-bc3e-4a1b007acf6d]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:56 devstack sudo[87645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71
Apr 16 19:51:56 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:56 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-15e541f8-1288-4f15-b493-ed17cecd7b90" returned: 0 in 0.557s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-15e541f8-1288-4f15-b493-ed17cecd7b90 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:56 devstack sudo[87650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-15e541f8-1288-4f15-b493-ed17cecd7b90
Apr 16 19:51:56 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:56 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" returned: 0 in 0.587s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:56 devstack sudo[87655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb
Apr 16 19:51:56 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:56 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-15e541f8-1288-4f15-b493-ed17cecd7b90" returned: 0 in 0.502s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Lock "cinder-quobyte-15e541f8-1288-4f15-b493-ed17cecd7b90" released by "delete_volume" :: held 1.085s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Created reservations ['5850cd41-a33e-4026-a75d-0f5b1086b127', '7f92f916-d3d2-40db-bc5c-639e0858e355', 'b4c47602-3c14-41d4-99e8-8326219165ee', '1d176852-31ed-4fdd-844d-f0ca3d3b00f8'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:57 devstack sudo[87658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:51:57 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:57 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb" returned: 0 in 0.577s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:57 devstack sudo[87663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb
Apr 16 19:51:57 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:57 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1164a3f7-ad91-4c7f-8ea0-c934edb9e378 tempest-GroupsV314Test-1069164429 None] Group tempest-GroupsV314Test-Group-535429090: creating
Apr 16 19:51:57 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1164a3f7-ad91-4c7f-8ea0-c934edb9e378 tempest-GroupsV314Test-1069164429 None] Group tempest-GroupsV314Test-Group-535429090: created successfully
Apr 16 19:51:57 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1164a3f7-ad91-4c7f-8ea0-c934edb9e378 tempest-GroupsV314Test-1069164429 None] Create group completed successfully.
Apr 16 19:51:57 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.495s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:51:57 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Deleted volume successfully.
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ef8ff1a-eb70-483f-8425-d597b387d1ce tempest-VolumesTransfersV357Test-1740682446 None] Lock "cinder-15e541f8-1288-4f15-b493-ed17cecd7b90-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:57 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71.2879aeb0-0394-4bf0-a2aa-90026eae0ebb" returned: 0 in 0.571s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-2879aeb0-0394-4bf0-a2aa-90026eae0ebb" released by "_delete_snapshot" :: held 2.460s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" released by "delete_snapshot" :: held 2.481s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:58 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Created reservations ['ab46a57f-9207-48ad-9815-7c823c57dfb0', 'a2e37ae5-3dc6-40a5-bb70-cff72c7c0c5d', 'be8aa7f3-1568-43d3-be98-fe997f9f9e75', '65a791bd-198c-4274-a8f7-1196f40752ba'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:51:58 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Delete snapshot completed successfully.
Apr 16 19:51:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-809788a9-f2e0-41d1-87d3-39da75067491 tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-2879aeb0-0394-4bf0-a2aa-90026eae0ebb-delete_snapshot" released by "delete_snapshot" :: held 2.704s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:51:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "cinder-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "cinder-quobyte-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:51:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:51:58 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2ccc68-7c45-400e-8f4e-6c19c774afba]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:51:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:58 devstack sudo[87696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71
Apr 16 19:51:58 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:58 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:51:58 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Flow 'volume_create_manager' (b652d4d2-4ee4-4e46-b9b9-1f18d17173cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:51:58 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815c4888-dabb-4b62-ba2f-af79fee4172f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815c4888-dabb-4b62-ba2f-af79fee4172f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1291127977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4e0a7f57-6a76-4fef-b09a-04c63a310133,host='devstack@QuobyteHD#QuobyteHD',id=4da3999c-ea38-47b7-85bc-532a216e5713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='166980ec2b914d8788d34c9170819819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:59Z,use_quota=True,user_id='a7f8a81f6d2a4beebe4e5642203b6dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a153b412-78f1-4ef2-9f83-b8cc6948aa7a),volume_type_id=a153b412-78f1-4ef2-9f83-b8cc6948aa7a)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0bdb15-fb2e-466c-99fe-679aa394bcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0bdb15-fb2e-466c-99fe-679aa394bcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4393d5-69a7-446c-9ab9-1341f5bd820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4393d5-69a7-446c-9ab9-1341f5bd820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da3999c-ea38-47b7-85bc-532a216e5713', 'volume_name': 'volume-4da3999c-ea38-47b7-85bc-532a216e5713', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40b6416-d1c5-431c-95da-30e0546b055e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40b6416-d1c5-431c-95da-30e0546b055e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca1a75b-e91d-46eb-81c2-605905dd6d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:51:59 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Volume 4da3999c-ea38-47b7-85bc-532a216e5713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da3999c-ea38-47b7-85bc-532a216e5713', 'volume_size': 1}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4e0a7f57-6a76-4fef-b09a-04c63a310133,created_at=2026-04-16T17:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1291127977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4e0a7f57-6a76-4fef-b09a-04c63a310133,host='devstack@QuobyteHD#QuobyteHD',id=4da3999c-ea38-47b7-85bc-532a216e5713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='166980ec2b914d8788d34c9170819819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:59Z,use_quota=True,user_id='a7f8a81f6d2a4beebe4e5642203b6dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a153b412-78f1-4ef2-9f83-b8cc6948aa7a),volume_type_id=a153b412-78f1-4ef2-9f83-b8cc6948aa7a)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Creating volume 4da3999c-ea38-47b7-85bc-532a216e5713 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:51:59 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:59 devstack sudo[87698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 1073741824
Apr 16 19:51:59 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:59 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 1073741824" returned: 0 in 0.670s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:59 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" returned: 0 in 0.985s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:51:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:51:59 devstack sudo[87706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713
Apr 16 19:51:59 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:51:59 devstack sudo[87707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71
Apr 16 19:51:59 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:00 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713" returned: 0 in 0.604s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca1a75b-e91d-46eb-81c2-605905dd6d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da3999c-ea38-47b7-85bc-532a216e5713', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36dc5785-73ad-4d35-b0b8-8348eff3c847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:00 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Volume volume-4da3999c-ea38-47b7-85bc-532a216e5713 (4da3999c-ea38-47b7-85bc-532a216e5713): created successfully
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36dc5785-73ad-4d35-b0b8-8348eff3c847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Flow 'volume_create_manager' (b652d4d2-4ee4-4e46-b9b9-1f18d17173cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:00 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ea9b0bd2-b4c8-4a85-89e4-df12e42306dd tempest-GroupsV314Test-1069164429 None] Created volume successfully.
Apr 16 19:52:00 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" returned: 0 in 0.680s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-quobyte-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71" released by "delete_volume" :: held 1.715s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Created reservations ['2a672421-b058-4ce0-8e73-e168062c8fea', 'b2f0f666-8100-4b96-9099-714431c1ac38', '27a4e387-7ce8-48a5-9f84-3aff03febe1f', 'bca64493-2e0c-4305-8bf0-ec5ab782bcb1'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:00 devstack sudo[87712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:52:00 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-e00da884-576a-4c69-a991-244098626f1a tempest-VolumesActionsTest-1478275988 None] Acquiring lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599" by "attach_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-e00da884-576a-4c69-a991-244098626f1a tempest-VolumesActionsTest-1478275988 None] Lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599" acquired by "attach_volume" :: waited 0.027s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:01 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-e00da884-576a-4c69-a991-244098626f1a tempest-VolumesActionsTest-1478275988 None] Attaching volume 4d11e7bf-3d3f-467c-9f62-99961cc75599 to instance 6b11f792-5ff0-4ded-a9bb-fce465e83662 at mountpoint /dev/vdb on host None.
Apr 16 19:52:01 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-e00da884-576a-4c69-a991-244098626f1a tempest-VolumesActionsTest-1478275988 None] Attach volume completed successfully.
Apr 16 19:52:01 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-e00da884-576a-4c69-a991-244098626f1a tempest-VolumesActionsTest-1478275988 None] Lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599" released by "attach_volume" :: held 0.220s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.751s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:01 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:52:01 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Deleted volume successfully.
Apr 16 19:52:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-39ef048f-b616-457b-919e-2ef5b394d7ff tempest-VolumesSnapshotListTestJSON-1668616572 None] Lock "cinder-8ca68825-dbab-4b11-b3e1-a85f8d3a5d71-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-acddf548-e6df-409b-b1b2-57eb3e21c13c tempest-VolumesActionsTest-1478275988 None] Acquiring lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599-detach_volume" by "detach_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-acddf548-e6df-409b-b1b2-57eb3e21c13c tempest-VolumesActionsTest-1478275988 None] Lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:01 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-acddf548-e6df-409b-b1b2-57eb3e21c13c tempest-VolumesActionsTest-1478275988 None] Detaching volume 4d11e7bf-3d3f-467c-9f62-99961cc75599 from instance 6b11f792-5ff0-4ded-a9bb-fce465e83662.
Apr 16 19:52:01 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-acddf548-e6df-409b-b1b2-57eb3e21c13c tempest-VolumesActionsTest-1478275988 None] Detach volume completed successfully.
Apr 16 19:52:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-acddf548-e6df-409b-b1b2-57eb3e21c13c tempest-VolumesActionsTest-1478275988 None] Lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:02 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Cloning volume 4da3999c-ea38-47b7-85bc-532a216e5713 to volume e477ca4b-d880-4369-b207-21cc1a95db42
Apr 16 19:52:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Creating offline snapshot 7ebb91b5-9d71-4bb3-8201-a647eedc1a2e of volume 4da3999c-ea38-47b7-85bc-532a216e5713 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:52:02 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f783bb0-0457-418c-ad9b-18336f693082]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:02 devstack sudo[87715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713
Apr 16 19:52:02 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:02 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Flow 'volume_create_manager' (7031e1a3-dd18-4f58-8737-0cace2023045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ec0a84-1d48-4208-8b8f-c231ce4ce8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ec0a84-1d48-4208-8b8f-c231ce4ce8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1323540617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59eb808e-85a9-4992-85de-dd2c0ec90746,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53a25bf3ddb0432da69e28c7edbaf85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:03Z,use_quota=True,user_id='8a4f1dc2065e471dbadc4eddb128fa1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c272d5-d881-40d9-b0f1-5a83b31e9a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c272d5-d881-40d9-b0f1-5a83b31e9a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1265c5-d90a-4a06-875c-723369cca416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1265c5-d90a-4a06-875c-723369cca416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59eb808e-85a9-4992-85de-dd2c0ec90746', 'volume_name': 'volume-59eb808e-85a9-4992-85de-dd2c0ec90746', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6319a1a4-f615-4e25-b0c7-e03ab794e5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6319a1a4-f615-4e25-b0c7-e03ab794e5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9768e88-98c5-41f2-b137-94840370b134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:03 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Volume 59eb808e-85a9-4992-85de-dd2c0ec90746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59eb808e-85a9-4992-85de-dd2c0ec90746', 'volume_size': 1}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:03 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713" returned: 0 in 0.962s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:03 devstack sudo[87755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e 1G
Apr 16 19:52:03 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Flow 'volume_create_manager' (ed5da5fd-0bd6-4c30-a264-cbdd971d0ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4943a5ad-454b-4e9c-9b4e-b9368c32f7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4943a5ad-454b-4e9c-9b4e-b9368c32f7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-200047743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e84431-af04-4142-8044-2eb8f6400f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ae67a64a14609b5c285f8631204ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:04Z,use_quota=True,user_id='fa646305295242b2866804e92698426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ae0d5c-0ef1-4605-9458-ba26776c01eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ae0d5c-0ef1-4605-9458-ba26776c01eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35559974-1e05-4c67-b1bf-a85077276100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35559974-1e05-4c67-b1bf-a85077276100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e84431-af04-4142-8044-2eb8f6400f13', 'volume_name': 'volume-91e84431-af04-4142-8044-2eb8f6400f13', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c46af8-c318-4e26-88e5-711ea3291ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c46af8-c318-4e26-88e5-711ea3291ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107f041d-9832-44e9-a5c4-bd60a03aaf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:03 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume 91e84431-af04-4142-8044-2eb8f6400f13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e84431-af04-4142-8044-2eb8f6400f13', 'volume_size': 1}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:03 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e 1G" returned: 0 in 0.692s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4da3999c-ea38-47b7-85bc-532a216e5713 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:03 devstack sudo[87789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4da3999c-ea38-47b7-85bc-532a216e5713 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e
Apr 16 19:52:03 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:04 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4da3999c-ea38-47b7-85bc-532a216e5713 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e" returned: 0 in 0.506s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:04 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:52:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:04 devstack sudo[87795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e
Apr 16 19:52:04 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:04 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e" returned: 0 in 0.427s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:04 devstack sudo[87800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.info
Apr 16 19:52:04 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:05 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.info" returned: 0 in 0.494s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:05 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:52:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:05 devstack sudo[87804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.info
Apr 16 19:52:05 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:05 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.info" returned: 0 in 0.424s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:05 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Acquiring lock "cinder-quobyte-e477ca4b-d880-4369-b207-21cc1a95db42" by "_copy_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:05 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Lock "cinder-quobyte-e477ca4b-d880-4369-b207-21cc1a95db42" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] snapshot: 7ebb91b5-9d71-4bb3-8201-a647eedc1a2e, volume: e477ca4b-d880-4369-b207-21cc1a95db42,  {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 19:52:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:05 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba8627d-a46a-4f8f-b210-95895e6971f0]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:05 devstack sudo[87807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e
Apr 16 19:52:05 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:06 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e" returned: 0 in 0.494s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4da3999c-ea38-47b7-85bc-532a216e5713(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:52:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 19:52:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Creating direct copy from snapshot {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 19:52:06 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[272d06f6-e1f9-41ec-bcd1-e644bd8bc3e2]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:06 devstack sudo[87812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713
Apr 16 19:52:06 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:06 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713" returned: 0 in 0.496s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:06 devstack cinder-volume[82616]: DEBUG cinder.utils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Path /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42 not found in is_blk_device check {{(pid=82616) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 19:52:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:06 devstack sudo[87817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42
Apr 16 19:52:06 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:08 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42" returned: 0 in 2.111s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:08 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5d3e80-e6c2-473a-b527-30cbaa8e2438]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:09 devstack sudo[87831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713
Apr 16 19:52:09 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:09 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713" returned: 0 in 0.653s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:09 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:52:09 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Converted 1024.00 MB image at 484.79 MB/s
Apr 16 19:52:09 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42 is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 19:52:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:09 devstack sudo[87840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42
Apr 16 19:52:09 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:10 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42" returned: 0 in 0.439s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Lock "cinder-quobyte-e477ca4b-d880-4369-b207-21cc1a95db42" released by "_copy_volume_from_snapshot" :: held 4.239s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Acquiring lock "cinder-quobyte-7ebb91b5-9d71-4bb3-8201-a647eedc1a2e" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Lock "cinder-quobyte-7ebb91b5-9d71-4bb3-8201-a647eedc1a2e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Deleting offline snapshot 7ebb91b5-9d71-4bb3-8201-a647eedc1a2e of volume 4da3999c-ea38-47b7-85bc-532a216e5713 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:52:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] snapshot_file for this snap is: volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:52:10 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[612f5b4f-afd9-4a68-87c2-d9ab721b2277]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:10 devstack sudo[87844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e
Apr 16 19:52:10 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:10 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e" returned: 0 in 0.482s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4da3999c-ea38-47b7-85bc-532a216e5713(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:52:10 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c880a8d7-1406-4058-8c9d-8e4185a0b6d3]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:10 devstack sudo[87849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713
Apr 16 19:52:10 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:11 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713" returned: 0 in 0.483s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:11 devstack sudo[87854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e
Apr 16 19:52:11 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:11 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_service.periodic_task [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82616) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e" returned: 0 in 0.457s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:11 devstack sudo[87859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:52:11 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:11 devstack sudo[87860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e
Apr 16 19:52:11 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:11 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:11 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713.7ebb91b5-9d71-4bb3-8201-a647eedc1a2e" returned: 0 in 0.422s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.447s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Lock "cinder-quobyte-7ebb91b5-9d71-4bb3-8201-a647eedc1a2e" released by "_delete_snapshot" :: held 1.914s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.826s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.882s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1323540617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59eb808e-85a9-4992-85de-dd2c0ec90746,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53a25bf3ddb0432da69e28c7edbaf85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:03Z,use_quota=True,user_id='8a4f1dc2065e471dbadc4eddb128fa1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Creating volume 59eb808e-85a9-4992-85de-dd2c0ec90746 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:52:11 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:52:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59eb808e-85a9-4992-85de-dd2c0ec90746 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:12 devstack sudo[87865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59eb808e-85a9-4992-85de-dd2c0ec90746 1073741824
Apr 16 19:52:12 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:12 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c2c8cba0-cf62-464b-960b-0b9abd9c7e8a tempest-GroupsV314Test-1069164429 None] Create group from source-group-4e0a7f57-6a76-4fef-b09a-04c63a310133 completed successfully.
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Acquiring lock "cinder-quobyte-e477ca4b-d880-4369-b207-21cc1a95db42" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Lock "cinder-quobyte-e477ca4b-d880-4369-b207-21cc1a95db42" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f879638-29a6-4291-b2a1-10cd8f5c76b3]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:12 devstack sudo[87867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42
Apr 16 19:52:12 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:12 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59eb808e-85a9-4992-85de-dd2c0ec90746 1073741824" returned: 0 in 0.492s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59eb808e-85a9-4992-85de-dd2c0ec90746 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:12 devstack sudo[87872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59eb808e-85a9-4992-85de-dd2c0ec90746
Apr 16 19:52:12 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:12 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42" returned: 0 in 0.563s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:12 devstack sudo[87878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42
Apr 16 19:52:12 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:12 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59eb808e-85a9-4992-85de-dd2c0ec90746" returned: 0 in 0.420s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.180s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-200047743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e84431-af04-4142-8044-2eb8f6400f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ae67a64a14609b5c285f8631204ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:04Z,use_quota=True,user_id='fa646305295242b2866804e92698426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Creating volume 91e84431-af04-4142-8044-2eb8f6400f13 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:52:12 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9768e88-98c5-41f2-b137-94840370b134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59eb808e-85a9-4992-85de-dd2c0ec90746', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:12 devstack sudo[87880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13 1073741824
Apr 16 19:52:12 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de83b3c-78fe-45bd-bb1b-635cf99ed83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:12 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Volume volume-59eb808e-85a9-4992-85de-dd2c0ec90746 (59eb808e-85a9-4992-85de-dd2c0ec90746): created successfully
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de83b3c-78fe-45bd-bb1b-635cf99ed83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:12 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Flow 'volume_create_manager' (7031e1a3-dd18-4f58-8737-0cace2023045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:12 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-32f75ab3-37b0-4264-9a58-c89248f91cae tempest-VolumesListTestJSON-210208374 None] Created volume successfully.
Apr 16 19:52:13 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e477ca4b-d880-4369-b207-21cc1a95db42" returned: 0 in 0.455s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Lock "cinder-quobyte-e477ca4b-d880-4369-b207-21cc1a95db42" released by "delete_volume" :: held 1.047s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Created reservations ['35c89cef-7f1d-495d-b3fe-29098f99217e'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:13 devstack cinder-volume[82616]: WARNING cinder.quota [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-628239045 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-628239045, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:52:13 devstack cinder-volume[82616]: WARNING cinder.quota [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-628239045 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-628239045, it is now deprecated. Please use the default quota class for default quota.
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Created reservations ['204a8da9-e4be-4cc9-b894-a6870f7c1883', '2db66926-7b4a-4717-b31b-7cd7cb0aec51', '42d06366-f152-4c7e-8fa5-6aaaacb86532', 'd4738185-4f41-4fcc-8d60-881fc2396c7c'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:13 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13 1073741824" returned: 0 in 0.591s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:13 devstack sudo[87886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:52:13 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:13 devstack sudo[87888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13
Apr 16 19:52:13 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Flow 'volume_create_manager' (a6f7c358-470e-4814-9863-44ee2105049b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12197ac8-1d17-45ae-8e33-2149a286172a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12197ac8-1d17-45ae-8e33-2149a286172a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1324580945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d00e4a-ac00-41f4-9bc6-67dc8cf46011,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53a25bf3ddb0432da69e28c7edbaf85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:14Z,use_quota=True,user_id='8a4f1dc2065e471dbadc4eddb128fa1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7170aaa-4837-46e1-adc3-433506c0883d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7170aaa-4837-46e1-adc3-433506c0883d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2acc69d-99ca-4de7-a24a-f0485626983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2acc69d-99ca-4de7-a24a-f0485626983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d00e4a-ac00-41f4-9bc6-67dc8cf46011', 'volume_name': 'volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401bce01-c9e2-4774-bd08-b91516d2c1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401bce01-c9e2-4774-bd08-b91516d2c1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b09234-a986-4883-a46d-466822b8739e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:13 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Volume 46d00e4a-ac00-41f4-9bc6-67dc8cf46011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011', 'volume_size': 1}
Apr 16 19:52:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:14 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.493s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:52:14 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-4eb0f349-2f8b-48d6-805a-4435417510ce tempest-GroupsV314Test-1069164429 None] Delete group completed successfully.
Apr 16 19:52:14 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13" returned: 0 in 0.475s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.144s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1324580945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d00e4a-ac00-41f4-9bc6-67dc8cf46011,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53a25bf3ddb0432da69e28c7edbaf85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:14Z,use_quota=True,user_id='8a4f1dc2065e471dbadc4eddb128fa1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Creating volume 46d00e4a-ac00-41f4-9bc6-67dc8cf46011 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:52:14 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107f041d-9832-44e9-a5c4-bd60a03aaf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e84431-af04-4142-8044-2eb8f6400f13', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7d235a-02f3-4835-a5d8-613465cf39bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:14 devstack sudo[87892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011 1073741824
Apr 16 19:52:14 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:14 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume volume-91e84431-af04-4142-8044-2eb8f6400f13 (91e84431-af04-4142-8044-2eb8f6400f13): created successfully
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7d235a-02f3-4835-a5d8-613465cf39bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Flow 'volume_create_manager' (ed5da5fd-0bd6-4c30-a264-cbdd971d0ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:14 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c79aff59-3961-49c2-9f48-adfd3dcce3b1 tempest-CreateVolumesFromSnapshotTest-30019624 None] Created volume successfully.
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:14 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011 1073741824" returned: 0 in 0.587s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Acquiring lock "cinder-quobyte-4da3999c-ea38-47b7-85bc-532a216e5713" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Lock "cinder-quobyte-4da3999c-ea38-47b7-85bc-532a216e5713" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:14 devstack sudo[87898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011
Apr 16 19:52:14 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e410909-a96c-4221-a731-572c6918482b]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:14 devstack sudo[87900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713
Apr 16 19:52:14 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:15 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011" returned: 0 in 0.543s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.864s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b09234-a986-4883-a46d-466822b8739e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812f58e1-a46c-4f7d-843b-72ab6df95afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] Creating offline snapshot 584437f8-5eac-4b8e-9e73-bdb5d754d497 of volume 91e84431-af04-4142-8044-2eb8f6400f13 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:52:15 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Volume volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011 (46d00e4a-ac00-41f4-9bc6-67dc8cf46011): created successfully
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812f58e1-a46c-4f7d-843b-72ab6df95afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Flow 'volume_create_manager' (a6f7c358-470e-4814-9863-44ee2105049b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0173e19f-e4c3-498a-bc5f-6ff33b36727a]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:15 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-238fc512-d1f1-464d-bbd4-556f0d130ba5 tempest-VolumesListTestJSON-210208374 None] Created volume successfully.
Apr 16 19:52:15 devstack sudo[87906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13
Apr 16 19:52:15 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:15 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713" returned: 0 in 0.676s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:15 devstack sudo[87908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713
Apr 16 19:52:15 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:15 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13" returned: 0 in 0.605s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:15 devstack sudo[87914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497 1G
Apr 16 19:52:15 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:15 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4da3999c-ea38-47b7-85bc-532a216e5713" returned: 0 in 0.588s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Lock "cinder-quobyte-4da3999c-ea38-47b7-85bc-532a216e5713" released by "delete_volume" :: held 1.308s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Created reservations ['dd941dd1-0a2d-45c8-8a84-f14315352db1'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Created reservations ['be7d01fc-e9e9-4543-aa74-fbc319b1fe05', '136116a8-d1dc-4a50-bb4f-0e0e1b883cd5', 'dbdae86b-ce8d-455e-abed-60da56db72b1', '148e19e6-e232-4082-a83d-53d46d23e828'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:16 devstack sudo[87917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:52:16 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Flow 'volume_create_manager' (06a32992-6aa8-4fb3-bff5-7b8dca6ab3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4352efbe-1624-482f-9397-1b684d6f8ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4352efbe-1624-482f-9397-1b684d6f8ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1029529426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6b2e8a-5066-46b0-9b2b-73b1f65d0754,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53a25bf3ddb0432da69e28c7edbaf85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:16Z,use_quota=True,user_id='8a4f1dc2065e471dbadc4eddb128fa1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231d08e6-fff3-4d58-8c12-6ae0c39a03bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231d08e6-fff3-4d58-8c12-6ae0c39a03bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a2feab-fd2c-49b6-bbbe-619eb29907c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a2feab-fd2c-49b6-bbbe-619eb29907c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6b2e8a-5066-46b0-9b2b-73b1f65d0754', 'volume_name': 'volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9780e48f-f071-4ef4-a705-c5124cad49cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9780e48f-f071-4ef4-a705-c5124cad49cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d3c69a-692e-49a3-a82f-1c145b3c712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:16 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Volume 0c6b2e8a-5066-46b0-9b2b-73b1f65d0754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754', 'volume_size': 1}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:16 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497 1G" returned: 0 in 0.650s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e84431-af04-4142-8044-2eb8f6400f13 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:16 devstack sudo[87926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e84431-af04-4142-8044-2eb8f6400f13 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497
Apr 16 19:52:16 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:16 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.505s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:16 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:52:16 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-adbc4393-21b2-40ba-8b1d-402cdd27008a tempest-GroupsV314Test-1069164429 None] Delete group completed successfully.
Apr 16 19:52:17 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e84431-af04-4142-8044-2eb8f6400f13 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497" returned: 0 in 0.525s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:17 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497 is being set with open permissions: ugo+rw
Apr 16 19:52:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:17 devstack sudo[87943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497
Apr 16 19:52:17 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:17 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497" returned: 0 in 0.479s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:17 devstack sudo[87946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.info
Apr 16 19:52:17 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:18 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.info" returned: 0 in 0.524s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:18 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.info is being set with open permissions: ugo+rw
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:18 devstack sudo[87949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.info
Apr 16 19:52:18 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:18 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.info" returned: 0 in 0.520s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.415s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.281s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1029529426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6b2e8a-5066-46b0-9b2b-73b1f65d0754,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53a25bf3ddb0432da69e28c7edbaf85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:16Z,use_quota=True,user_id='8a4f1dc2065e471dbadc4eddb128fa1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Creating volume 0c6b2e8a-5066-46b0-9b2b-73b1f65d0754 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:52:18 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:52:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:18 devstack sudo[87952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754 1073741824
Apr 16 19:52:18 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:18 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-896a8ea3-7aed-42e7-80ca-c533c019beb9 tempest-CreateVolumesFromSnapshotTest-30019624 None] Create snapshot completed successfully
Apr 16 19:52:19 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754 1073741824" returned: 0 in 0.660s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:19 devstack sudo[87960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754
Apr 16 19:52:19 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:19 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754" returned: 0 in 0.463s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d3c69a-692e-49a3-a82f-1c145b3c712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffdafef-e3e9-4420-9d6f-aaf083100800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:19 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Volume volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754 (0c6b2e8a-5066-46b0-9b2b-73b1f65d0754): created successfully
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffdafef-e3e9-4420-9d6f-aaf083100800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Flow 'volume_create_manager' (06a32992-6aa8-4fb3-bff5-7b8dca6ab3da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:19 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-591c325b-d94f-4412-92a6-e4098d99132e tempest-VolumesListTestJSON-210208374 None] Created volume successfully.
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Flow 'volume_create_manager' (fcc61e16-6e9d-4f68-91c5-77259090ecf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f052ddaf-bce4-43ef-93c9-09d97ce3216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f052ddaf-bce4-43ef-93c9-09d97ce3216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1742298189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37bdf1f5-2756-498c-8150-3d9e30133d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ae67a64a14609b5c285f8631204ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:20Z,use_quota=True,user_id='fa646305295242b2866804e92698426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f9c907-8b04-44ad-a7ea-929f87b40b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f9c907-8b04-44ad-a7ea-929f87b40b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd0badc-5f47-4e07-ac61-c151217e3f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd0badc-5f47-4e07-ac61-c151217e3f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37bdf1f5-2756-498c-8150-3d9e30133d8e', 'volume_name': 'volume-37bdf1f5-2756-498c-8150-3d9e30133d8e', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebce9e52-af8e-4719-a289-c7500866d666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebce9e52-af8e-4719-a289-c7500866d666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bca48c-7a45-4a8b-a404-1e7f98f2cc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:19 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume 37bdf1f5-2756-498c-8150-3d9e30133d8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37bdf1f5-2756-498c-8150-3d9e30133d8e', 'volume_size': 1}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1742298189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37bdf1f5-2756-498c-8150-3d9e30133d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ae67a64a14609b5c285f8631204ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:20Z,use_quota=True,user_id='fa646305295242b2866804e92698426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Creating volume 37bdf1f5-2756-498c-8150-3d9e30133d8e {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:52:19 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:52:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-37bdf1f5-2756-498c-8150-3d9e30133d8e 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:19 devstack sudo[87963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-37bdf1f5-2756-498c-8150-3d9e30133d8e 1073741824
Apr 16 19:52:19 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Flow 'volume_create_manager' (5af64116-dd34-4956-9dae-d62eea757630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788dcfc6-02e3-469b-b4c1-3ebc7335268c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788dcfc6-02e3-469b-b4c1-3ebc7335268c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918653709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcc7de2-a5f6-48d2-9009-df0c3556e1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ae67a64a14609b5c285f8631204ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:20Z,use_quota=True,user_id='fa646305295242b2866804e92698426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4576d2-4d85-4c13-b8ac-b1acb88d9bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4576d2-4d85-4c13-b8ac-b1acb88d9bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf57ae3-c853-4c6d-8e17-4a1d8048817b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf57ae3-c853-4c6d-8e17-4a1d8048817b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfcc7de2-a5f6-48d2-9009-df0c3556e1e0', 'volume_name': 'volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1913504-887b-42e0-96a7-f1cbd9fbb8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1913504-887b-42e0-96a7-f1cbd9fbb8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378c0b21-11eb-4fd2-9198-dce5f14c4808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume cfcc7de2-a5f6-48d2-9009-df0c3556e1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0', 'volume_size': 1}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Flow 'volume_create_manager' (fc04fe7b-2dc2-49bf-b1ab-5bad83580bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076b9cea-4391-45db-a1f9-79262af5046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076b9cea-4391-45db-a1f9-79262af5046a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1069334952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a70c98-eb18-42fa-affe-6d2eb8c7e547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ae67a64a14609b5c285f8631204ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:20Z,use_quota=True,user_id='fa646305295242b2866804e92698426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7936e2f-7596-4aa1-abd2-29336f6ca364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7936e2f-7596-4aa1-abd2-29336f6ca364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42074188-d84c-4a2c-b67a-67a611df99e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42074188-d84c-4a2c-b67a-67a611df99e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a70c98-eb18-42fa-affe-6d2eb8c7e547', 'volume_name': 'volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7b39bb-7ce7-4cdf-8381-810f0c76abb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7b39bb-7ce7-4cdf-8381-810f0c76abb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb98ae4e-8146-41a0-ad81-88c96942b8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume 02a70c98-eb18-42fa-affe-6d2eb8c7e547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547', 'volume_size': 1}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Flow 'volume_create_manager' (aa4aab2f-eaed-44c4-8f03-659bf8bd342e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef35dfa2-cefd-4f52-9bfd-d2c38a6b30bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=158,cinder:INSERT=50,cinder:UPDATE=206,cinder:DELETE=13 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef35dfa2-cefd-4f52-9bfd-d2c38a6b30bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-697840017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422fb2a383da4251970ea6bbd11d18ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:20Z,use_quota=True,user_id='59fbcf6a6a9e4013a31b683186f85869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7a685c-5944-4d48-94a4-39c754015446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7a685c-5944-4d48-94a4-39c754015446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369b0b25-8493-4a27-b938-d93e3af7c4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369b0b25-8493-4a27-b938-d93e3af7c4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626', 'volume_name': 'volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6499265-63b8-4009-8455-76e2449aa829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6499265-63b8-4009-8455-76e2449aa829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3abcb0-cd2d-4bea-99b4-0987843101ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Volume ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626', 'volume_size': 1}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Flow 'volume_create_manager' (27ee31fd-641a-487b-a0ce-fc50d9644744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b254ae1-d0e6-43b5-a424-da6c7935a468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b254ae1-d0e6-43b5-a424-da6c7935a468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-802306636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f2e36a-6633-4749-8eb0-e8f312a11a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ae67a64a14609b5c285f8631204ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:21Z,use_quota=True,user_id='fa646305295242b2866804e92698426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cf84c6-77e6-4e92-8230-a7d6c83d5308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cf84c6-77e6-4e92-8230-a7d6c83d5308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9edd6f-a216-4297-a62f-6700fb6f72cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9edd6f-a216-4297-a62f-6700fb6f72cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71f2e36a-6633-4749-8eb0-e8f312a11a66', 'volume_name': 'volume-71f2e36a-6633-4749-8eb0-e8f312a11a66', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f723b259-6c1a-4802-8cf5-46d9f07be412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f723b259-6c1a-4802-8cf5-46d9f07be412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbef0be3-a7d3-4d07-a500-868503ab9aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume 71f2e36a-6633-4749-8eb0-e8f312a11a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71f2e36a-6633-4749-8eb0-e8f312a11a66', 'volume_size': 1}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:20 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-37bdf1f5-2756-498c-8150-3d9e30133d8e 1073741824" returned: 0 in 0.745s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-37bdf1f5-2756-498c-8150-3d9e30133d8e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:20 devstack sudo[87968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-37bdf1f5-2756-498c-8150-3d9e30133d8e
Apr 16 19:52:20 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Flow 'volume_create_manager' (2446da2e-13c0-432f-8f71-ffbd31e605f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af12c68-fb26-44dd-88dd-12d5414791e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af12c68-fb26-44dd-88dd-12d5414791e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1292226365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24875951-74d1-40b9-a84d-7df186948f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ae67a64a14609b5c285f8631204ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:21Z,use_quota=True,user_id='fa646305295242b2866804e92698426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ce435d-44c6-4ec9-aac9-f828ecfa1903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ce435d-44c6-4ec9-aac9-f828ecfa1903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241f18cc-32b7-4e77-8965-c0677ea859d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241f18cc-32b7-4e77-8965-c0677ea859d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24875951-74d1-40b9-a84d-7df186948f26', 'volume_name': 'volume-24875951-74d1-40b9-a84d-7df186948f26', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f55d984-c485-4f2a-b035-3980481cc21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f55d984-c485-4f2a-b035-3980481cc21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3186d9-855a-4dde-b3be-7474519677ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:20 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume 24875951-74d1-40b9-a84d-7df186948f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24875951-74d1-40b9-a84d-7df186948f26', 'volume_size': 1}
Apr 16 19:52:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:21 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-37bdf1f5-2756-498c-8150-3d9e30133d8e" returned: 0 in 0.584s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.158s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918653709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcc7de2-a5f6-48d2-9009-df0c3556e1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ae67a64a14609b5c285f8631204ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:20Z,use_quota=True,user_id='fa646305295242b2866804e92698426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Creating volume cfcc7de2-a5f6-48d2-9009-df0c3556e1e0 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:52:21 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:21 devstack sudo[87997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0 1073741824
Apr 16 19:52:21 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bca48c-7a45-4a8b-a404-1e7f98f2cc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37bdf1f5-2756-498c-8150-3d9e30133d8e', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff67889-ff5f-4a09-b04f-0953b4f52d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:21 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume volume-37bdf1f5-2756-498c-8150-3d9e30133d8e (37bdf1f5-2756-498c-8150-3d9e30133d8e): created successfully
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff67889-ff5f-4a09-b04f-0953b4f52d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Flow 'volume_create_manager' (fcc61e16-6e9d-4f68-91c5-77259090ecf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:21 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-212fb4df-aba0-41a8-8779-80e5f2c8097a tempest-CreateVolumesFromSnapshotTest-30019624 None] Created volume successfully.
Apr 16 19:52:22 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0 1073741824" returned: 0 in 0.749s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:22 devstack sudo[88005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0
Apr 16 19:52:22 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:22 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0" returned: 0 in 0.492s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.223s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1069334952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a70c98-eb18-42fa-affe-6d2eb8c7e547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ae67a64a14609b5c285f8631204ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:20Z,use_quota=True,user_id='fa646305295242b2866804e92698426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Creating volume 02a70c98-eb18-42fa-affe-6d2eb8c7e547 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:52:22 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378c0b21-11eb-4fd2-9198-dce5f14c4808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fb58c0-807e-4bdb-83c6-cb45d450c79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:22 devstack sudo[88008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547 1073741824
Apr 16 19:52:22 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=141,cinder:UPDATE=178,cinder:INSERT=41,cinder:DELETE=16 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:52:22 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0 (cfcc7de2-a5f6-48d2-9009-df0c3556e1e0): created successfully
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fb58c0-807e-4bdb-83c6-cb45d450c79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Flow 'volume_create_manager' (5af64116-dd34-4956-9dae-d62eea757630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:22 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-29941499-252a-429c-9aa5-3e5e89a0d2cc tempest-CreateVolumesFromSnapshotTest-30019624 None] Created volume successfully.
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a207e59b-f1e5-44ed-99f0-23efb0379078 tempest-VolumesActionsTest-1478275988 None] Acquiring lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599" by "attach_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a207e59b-f1e5-44ed-99f0-23efb0379078 tempest-VolumesActionsTest-1478275988 None] Lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599" acquired by "attach_volume" :: waited 0.022s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:22 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a207e59b-f1e5-44ed-99f0-23efb0379078 tempest-VolumesActionsTest-1478275988 None] Attaching volume 4d11e7bf-3d3f-467c-9f62-99961cc75599 to instance c00bdfd6-fba3-4b75-88a3-71fd37463372 at mountpoint /dev/vdb on host None.
Apr 16 19:52:22 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a207e59b-f1e5-44ed-99f0-23efb0379078 tempest-VolumesActionsTest-1478275988 None] Attach volume completed successfully.
Apr 16 19:52:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a207e59b-f1e5-44ed-99f0-23efb0379078 tempest-VolumesActionsTest-1478275988 None] Lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599" released by "attach_volume" :: held 0.081s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Acquiring lock "cinder-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Lock "cinder-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Acquiring lock "cinder-quobyte-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Lock "cinder-quobyte-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05c554e-0b5c-4af3-b30a-e67ff84d16e9]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:23 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547 1073741824" returned: 0 in 0.628s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:23 devstack sudo[88014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547
Apr 16 19:52:23 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:23 devstack sudo[88013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754
Apr 16 19:52:23 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-23932c6f-ff14-43eb-be6a-cb1ddb1133fe tempest-VolumesActionsTest-1478275988 None] Acquiring lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599-detach_volume" by "detach_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-23932c6f-ff14-43eb-be6a-cb1ddb1133fe tempest-VolumesActionsTest-1478275988 None] Lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:23 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-23932c6f-ff14-43eb-be6a-cb1ddb1133fe tempest-VolumesActionsTest-1478275988 None] Detaching volume 4d11e7bf-3d3f-467c-9f62-99961cc75599 from instance c00bdfd6-fba3-4b75-88a3-71fd37463372.
Apr 16 19:52:23 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-23932c6f-ff14-43eb-be6a-cb1ddb1133fe tempest-VolumesActionsTest-1478275988 None] Detach volume completed successfully.
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-23932c6f-ff14-43eb-be6a-cb1ddb1133fe tempest-VolumesActionsTest-1478275988 None] Lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599-detach_volume" released by "detach_volume" :: held 0.052s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:23 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754" returned: 0 in 0.547s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:23 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547" returned: 0 in 0.523s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.283s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-697840017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422fb2a383da4251970ea6bbd11d18ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:20Z,use_quota=True,user_id='59fbcf6a6a9e4013a31b683186f85869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Creating volume ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:23 devstack sudo[88021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754
Apr 16 19:52:23 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:52:23 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb98ae4e-8146-41a0-ad81-88c96942b8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:23 devstack sudo[88023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 1073741824
Apr 16 19:52:23 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3dfe28-9672-4f9a-adeb-a393c8cab15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:23 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547 (02a70c98-eb18-42fa-affe-6d2eb8c7e547): created successfully
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3dfe28-9672-4f9a-adeb-a393c8cab15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Flow 'volume_create_manager' (fc04fe7b-2dc2-49bf-b1ab-5bad83580bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:23 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-d301b705-926c-4c87-a559-8336df9ace90 tempest-CreateVolumesFromSnapshotTest-30019624 None] Created volume successfully.
Apr 16 19:52:24 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754" returned: 0 in 0.542s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Lock "cinder-quobyte-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754" released by "delete_volume" :: held 1.116s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Created reservations ['7e812432-a76a-4ecc-a45b-3127a197c2a9', 'b36be0e9-7d81-4b9b-b2d4-cc83542acb66', '598c2da9-0c2e-4067-b7af-986862808b3c', 'f448e00a-243d-4afb-bbc4-6ede3707074b'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:24 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 1073741824" returned: 0 in 0.671s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:24 devstack sudo[88030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:52:24 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:24 devstack sudo[88032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626
Apr 16 19:52:24 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:24 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.441s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:52:24 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Deleted volume successfully.
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fb1ecf35-1c81-44e5-b0ad-c750e2a4a5ca tempest-VolumesListTestJSON-210208374 None] Lock "cinder-0c6b2e8a-5066-46b0-9b2b-73b1f65d0754-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:24 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" returned: 0 in 0.452s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.343s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-802306636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f2e36a-6633-4749-8eb0-e8f312a11a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ae67a64a14609b5c285f8631204ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:21Z,use_quota=True,user_id='fa646305295242b2866804e92698426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:52:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Creating volume 71f2e36a-6633-4749-8eb0-e8f312a11a66 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:52:25 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-71f2e36a-6633-4749-8eb0-e8f312a11a66 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3abcb0-cd2d-4bea-99b4-0987843101ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:25 devstack sudo[88037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-71f2e36a-6633-4749-8eb0-e8f312a11a66 1073741824
Apr 16 19:52:25 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2899b335-bd2e-4c22-bf75-f025b5302f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:25 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Volume volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 (ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626): created successfully
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2899b335-bd2e-4c22-bf75-f025b5302f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Flow 'volume_create_manager' (aa4aab2f-eaed-44c4-8f03-659bf8bd342e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:25 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0db4b8b9-fb2a-49bf-9093-fac6b74e8be3 tempest-SnapshotsActionsTest-1038725633 None] Created volume successfully.
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Acquiring lock "cinder-46d00e4a-ac00-41f4-9bc6-67dc8cf46011-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Lock "cinder-46d00e4a-ac00-41f4-9bc6-67dc8cf46011-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Acquiring lock "cinder-quobyte-46d00e4a-ac00-41f4-9bc6-67dc8cf46011" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Lock "cinder-quobyte-46d00e4a-ac00-41f4-9bc6-67dc8cf46011" acquired by "delete_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee5234c-f396-4224-862b-385057d150aa]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:25 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-71f2e36a-6633-4749-8eb0-e8f312a11a66 1073741824" returned: 0 in 0.670s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:25 devstack sudo[88070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011
Apr 16 19:52:25 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-71f2e36a-6633-4749-8eb0-e8f312a11a66 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:25 devstack sudo[88072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-71f2e36a-6633-4749-8eb0-e8f312a11a66
Apr 16 19:52:25 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:26 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011" returned: 0 in 0.531s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:26 devstack sudo[88079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011
Apr 16 19:52:26 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:26 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-71f2e36a-6633-4749-8eb0-e8f312a11a66" returned: 0 in 0.484s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.227s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1292226365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24875951-74d1-40b9-a84d-7df186948f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ae67a64a14609b5c285f8631204ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:21Z,use_quota=True,user_id='fa646305295242b2866804e92698426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Creating volume 24875951-74d1-40b9-a84d-7df186948f26 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:52:26 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-24875951-74d1-40b9-a84d-7df186948f26 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbef0be3-a7d3-4d07-a500-868503ab9aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f2e36a-6633-4749-8eb0-e8f312a11a66', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:26 devstack sudo[88081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-24875951-74d1-40b9-a84d-7df186948f26 1073741824
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02739c11-ea6c-425e-a8e0-12f6a6ffaa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:26 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:26 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume volume-71f2e36a-6633-4749-8eb0-e8f312a11a66 (71f2e36a-6633-4749-8eb0-e8f312a11a66): created successfully
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02739c11-ea6c-425e-a8e0-12f6a6ffaa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Flow 'volume_create_manager' (27ee31fd-641a-487b-a0ce-fc50d9644744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:26 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ceb29bf1-a64c-4848-8546-ca1d5294e7a3 tempest-CreateVolumesFromSnapshotTest-30019624 None] Created volume successfully.
Apr 16 19:52:26 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-46d00e4a-ac00-41f4-9bc6-67dc8cf46011" returned: 0 in 0.414s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Lock "cinder-quobyte-46d00e4a-ac00-41f4-9bc6-67dc8cf46011" released by "delete_volume" :: held 1.000s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Created reservations ['e0cc8f09-6358-4cee-8971-977ef59b8725', 'f5e17e1b-9992-4641-b1f3-c97b8c2553bf', 'dd519914-7bac-4a5b-a78f-86dc66a6fb35', '3b40472b-3150-430d-8889-4ecfeca64074'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:26 devstack sudo[88088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:52:26 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:26 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-24875951-74d1-40b9-a84d-7df186948f26 1073741824" returned: 0 in 0.556s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-24875951-74d1-40b9-a84d-7df186948f26 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:26 devstack sudo[88090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-24875951-74d1-40b9-a84d-7df186948f26
Apr 16 19:52:26 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:27 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.499s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:52:27 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Deleted volume successfully.
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1721f9fb-920a-43c5-8d83-4074a11b9013 tempest-VolumesListTestJSON-210208374 None] Lock "cinder-46d00e4a-ac00-41f4-9bc6-67dc8cf46011-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:27 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-24875951-74d1-40b9-a84d-7df186948f26" returned: 0 in 0.466s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.302s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3186d9-855a-4dde-b3be-7474519677ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24875951-74d1-40b9-a84d-7df186948f26', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ee8c39-0559-4732-8738-5fa7f1fe1590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] Creating offline snapshot 8ff841b5-09de-406c-befa-d942b908d53b of volume ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:52:27 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Volume volume-24875951-74d1-40b9-a84d-7df186948f26 (24875951-74d1-40b9-a84d-7df186948f26): created successfully
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ee8c39-0559-4732-8738-5fa7f1fe1590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Flow 'volume_create_manager' (2446da2e-13c0-432f-8f71-ffbd31e605f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bb5e2d-2f53-4298-9eca-3dc796ba2c69]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:27 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-9676bb2e-a6f4-4932-b3a8-78edce72ce3c tempest-CreateVolumesFromSnapshotTest-30019624 None] Created volume successfully.
Apr 16 19:52:27 devstack sudo[88095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626
Apr 16 19:52:27 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-24875951-74d1-40b9-a84d-7df186948f26-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-24875951-74d1-40b9-a84d-7df186948f26-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-quobyte-24875951-74d1-40b9-a84d-7df186948f26" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-24875951-74d1-40b9-a84d-7df186948f26" acquired by "delete_volume" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cf75ed-1d59-4bd4-993b-fe7b5379cfce]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-24875951-74d1-40b9-a84d-7df186948f26 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:27 devstack sudo[88097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-24875951-74d1-40b9-a84d-7df186948f26
Apr 16 19:52:27 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Acquiring lock "cinder-59eb808e-85a9-4992-85de-dd2c0ec90746-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Lock "cinder-59eb808e-85a9-4992-85de-dd2c0ec90746-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Acquiring lock "cinder-quobyte-59eb808e-85a9-4992-85de-dd2c0ec90746" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Lock "cinder-quobyte-59eb808e-85a9-4992-85de-dd2c0ec90746" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab1131a-df95-4100-9dd1-45c32aedefe8]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59eb808e-85a9-4992-85de-dd2c0ec90746 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:27 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" returned: 0 in 0.573s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:27 devstack sudo[88102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59eb808e-85a9-4992-85de-dd2c0ec90746
Apr 16 19:52:27 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:27 devstack sudo[88103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b 1G
Apr 16 19:52:27 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:28 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-24875951-74d1-40b9-a84d-7df186948f26" returned: 0 in 0.541s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-24875951-74d1-40b9-a84d-7df186948f26 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:28 devstack sudo[88109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-24875951-74d1-40b9-a84d-7df186948f26
Apr 16 19:52:28 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:28 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59eb808e-85a9-4992-85de-dd2c0ec90746" returned: 0 in 0.543s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59eb808e-85a9-4992-85de-dd2c0ec90746 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:28 devstack sudo[88117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59eb808e-85a9-4992-85de-dd2c0ec90746
Apr 16 19:52:28 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:28 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b 1G" returned: 0 in 0.508s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:28 devstack sudo[88119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b
Apr 16 19:52:28 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:28 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-24875951-74d1-40b9-a84d-7df186948f26" returned: 0 in 0.431s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-24875951-74d1-40b9-a84d-7df186948f26" released by "delete_volume" :: held 1.004s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Created reservations ['548d57d0-dc76-45f1-a7d3-3ac2eeda57a5', '9e830dda-86af-49ec-9f3e-568e2a6c6028', 'b804803b-1379-4f83-9540-955dc34a8475', '74455325-5941-4dd1-af1e-160132d6c029'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:28 devstack sudo[88122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:52:28 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:28 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-59eb808e-85a9-4992-85de-dd2c0ec90746" returned: 0 in 0.473s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Lock "cinder-quobyte-59eb808e-85a9-4992-85de-dd2c0ec90746" released by "delete_volume" :: held 1.039s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:28 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b" returned: 0 in 0.498s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:28 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b is being set with open permissions: ugo+rw
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Created reservations ['23c7ed80-457f-4567-b238-4dbdf74bc24d', '8df5d6b8-97b0-4262-b344-d454d7c1d04e', '640b6e67-1ba1-419b-84e7-04e4c4964ca1', 'e15e2221-1f34-48a7-8971-007f454e8d2d'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:28 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b
Apr 16 19:52:28 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:28 devstack sudo[88130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:52:28 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:29 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.438s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:52:29 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Deleted volume successfully.
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eb7a9648-9402-4feb-946b-3decd2af38ed tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-24875951-74d1-40b9-a84d-7df186948f26-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:29 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b" returned: 0 in 0.425s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:29 devstack sudo[88135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.info
Apr 16 19:52:29 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:29 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.461s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:52:29 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Deleted volume successfully.
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-703a5f0d-83c7-4905-8fa7-532dd362d2cc tempest-VolumesListTestJSON-210208374 None] Lock "cinder-59eb808e-85a9-4992-85de-dd2c0ec90746-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-71f2e36a-6633-4749-8eb0-e8f312a11a66-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-71f2e36a-6633-4749-8eb0-e8f312a11a66-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-quobyte-71f2e36a-6633-4749-8eb0-e8f312a11a66" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-71f2e36a-6633-4749-8eb0-e8f312a11a66" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[68999f79-2f4d-49b9-87e6-68e05f53f4b8]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-71f2e36a-6633-4749-8eb0-e8f312a11a66 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:29 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.info" returned: 0 in 0.492s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:29 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.info is being set with open permissions: ugo+rw
Apr 16 19:52:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:29 devstack sudo[88139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-71f2e36a-6633-4749-8eb0-e8f312a11a66
Apr 16 19:52:29 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:29 devstack sudo[88140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.info
Apr 16 19:52:29 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:30 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.info" returned: 0 in 0.458s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:30 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.033s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-71f2e36a-6633-4749-8eb0-e8f312a11a66" returned: 0 in 0.529s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-71f2e36a-6633-4749-8eb0-e8f312a11a66 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:30 devstack sudo[88147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-71f2e36a-6633-4749-8eb0-e8f312a11a66
Apr 16 19:52:30 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:30 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-3141a204-f66c-450d-b92c-f011c6fef4de tempest-SnapshotsActionsTest-1038725633 None] Create snapshot completed successfully
Apr 16 19:52:30 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-71f2e36a-6633-4749-8eb0-e8f312a11a66" returned: 0 in 0.501s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-71f2e36a-6633-4749-8eb0-e8f312a11a66" released by "delete_volume" :: held 1.065s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:30 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Created reservations ['3935e8ae-c4f1-4e84-a3ef-a1c639bdd83d', '9361cf2f-7940-4797-90c7-03ea85d3aec2', 'd419a84b-727b-420a-a293-bbf506372365', '42c6d54e-4e08-44f7-9653-4e03e5c31e1b'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:30 devstack sudo[88152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:52:30 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:31 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.429s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:52:31 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Deleted volume successfully.
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0e46bd79-fb71-426c-bada-2010b23a40ec tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-71f2e36a-6633-4749-8eb0-e8f312a11a66-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] Creating offline snapshot b3528900-68ba-4277-ba4e-f1ad1347bfdc of volume ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1934ab20-3c9f-4bc7-ba02-be90c7d4d377]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:31 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b
Apr 16 19:52:31 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-02a70c98-eb18-42fa-affe-6d2eb8c7e547-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Flow 'volume_create_manager' (c01ecbaf-549d-4022-a663-231609a2c1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61e18e0-ce98-4a46-a4c0-6711b75dd575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-02a70c98-eb18-42fa-affe-6d2eb8c7e547-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61e18e0-ce98-4a46-a4c0-6711b75dd575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1316663304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb59bac-1ba0-46db-a22f-2adc44c4734a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140e067af14e4f4ea9abf0790b5481a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:32Z,use_quota=True,user_id='c32f84351b264395960ea570ef516129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d64d98-4079-4be7-8781-da3529a62829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d64d98-4079-4be7-8781-da3529a62829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f97b494-9b26-40ae-80f3-0a7e1eee281e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f97b494-9b26-40ae-80f3-0a7e1eee281e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb59bac-1ba0-46db-a22f-2adc44c4734a', 'volume_name': 'volume-afb59bac-1ba0-46db-a22f-2adc44c4734a', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362f4884-0134-4ae7-b185-2211f8014d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:31 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362f4884-0134-4ae7-b185-2211f8014d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec896629-ed69-483b-8ba7-75dd887b3248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:32 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Volume afb59bac-1ba0-46db-a22f-2adc44c4734a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb59bac-1ba0-46db-a22f-2adc44c4734a', 'volume_size': 1}
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-quobyte-02a70c98-eb18-42fa-affe-6d2eb8c7e547" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-02a70c98-eb18-42fa-affe-6d2eb8c7e547" acquired by "delete_volume" :: waited 0.006s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b982e0-1540-4c54-8787-1e18745fa0f3]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:32 devstack sudo[88163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547
Apr 16 19:52:32 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:32 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b" returned: 0 in 0.545s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:32 devstack sudo[88168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc 1G
Apr 16 19:52:32 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:32 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547" returned: 0 in 0.538s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:32 devstack sudo[88176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547
Apr 16 19:52:32 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:32 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc 1G" returned: 0 in 0.568s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:32 devstack sudo[88178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc
Apr 16 19:52:32 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:33 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-02a70c98-eb18-42fa-affe-6d2eb8c7e547" returned: 0 in 0.451s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-02a70c98-eb18-42fa-affe-6d2eb8c7e547" released by "delete_volume" :: held 1.010s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Created reservations ['1f852b76-86c2-4eae-a1e6-aa11cf28ef26', '4094a414-7acc-471d-971a-d10ebdcc13bd', '24393a1c-95ce-4c50-a2f5-b01c37110cdd', '49fee6e0-9eeb-4fdd-8dfc-97142678b5be'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:33 devstack sudo[88181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:52:33 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:33 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc" returned: 0 in 0.480s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:33 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc is being set with open permissions: ugo+rw
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:33 devstack sudo[88186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc
Apr 16 19:52:33 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:33 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.423s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:52:33 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Deleted volume successfully.
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8b333911-4ad6-4cc3-bdc8-f29b1fa1a4ee tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-02a70c98-eb18-42fa-affe-6d2eb8c7e547-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:33 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc" returned: 0 in 0.406s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.647s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1316663304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb59bac-1ba0-46db-a22f-2adc44c4734a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140e067af14e4f4ea9abf0790b5481a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:32Z,use_quota=True,user_id='c32f84351b264395960ea570ef516129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Creating volume afb59bac-1ba0-46db-a22f-2adc44c4734a {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:52:33 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:52:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-afb59bac-1ba0-46db-a22f-2adc44c4734a 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:33 devstack sudo[88190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-afb59bac-1ba0-46db-a22f-2adc44c4734a 1073741824
Apr 16 19:52:33 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:33 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-730724ff-bd87-4c34-9677-457727ebf986 tempest-SnapshotsActionsTest-1038725633 None] Create snapshot completed successfully
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-quobyte-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0" acquired by "delete_volume" :: waited 0.006s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[153d026a-854d-4b07-9cb8-3e598f9ddbd8]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:34 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-afb59bac-1ba0-46db-a22f-2adc44c4734a 1073741824" returned: 0 in 0.518s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-afb59bac-1ba0-46db-a22f-2adc44c4734a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:34 devstack sudo[88195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0
Apr 16 19:52:34 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:34 devstack sudo[88196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-afb59bac-1ba0-46db-a22f-2adc44c4734a
Apr 16 19:52:34 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:34 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-afb59bac-1ba0-46db-a22f-2adc44c4734a" returned: 0 in 0.397s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:34 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.696s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0" returned: 0 in 0.465s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93d1c58-3c67-466e-90e0-bd0ed0edccd3]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:34 devstack sudo[88204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0
Apr 16 19:52:34 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec896629-ed69-483b-8ba7-75dd887b3248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb59bac-1ba0-46db-a22f-2adc44c4734a', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3dd3dd-3061-4e0e-a396-db555b6bdb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:34 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Volume volume-afb59bac-1ba0-46db-a22f-2adc44c4734a (afb59bac-1ba0-46db-a22f-2adc44c4734a): created successfully
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3dd3dd-3061-4e0e-a396-db555b6bdb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Flow 'volume_create_manager' (c01ecbaf-549d-4022-a663-231609a2c1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:34 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c900035c-5f28-4ad3-8ffa-662550dd3809 tempest-VolumesNegativeTest-1661416955 None] Created volume successfully.
Apr 16 19:52:34 devstack sudo[88205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599
Apr 16 19:52:34 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Acquiring lock "cinder-b3528900-68ba-4277-ba4e-f1ad1347bfdc-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-b3528900-68ba-4277-ba4e-f1ad1347bfdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Acquiring lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Acquiring lock "cinder-quobyte-b3528900-68ba-4277-ba4e-f1ad1347bfdc" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-b3528900-68ba-4277-ba4e-f1ad1347bfdc" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Deleting offline snapshot b3528900-68ba-4277-ba4e-f1ad1347bfdc of volume ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] snapshot_file for this snap is: volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7853fe57-54de-4854-b338-36b59fbf4c34]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:34 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc
Apr 16 19:52:34 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:35 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0" returned: 0 in 0.484s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0" released by "delete_volume" :: held 0.979s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:35 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599" returned: 0 in 0.526s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Created reservations ['9577edd3-af33-4236-9a9a-09024c6d1a23', 'f0f9e891-615e-4c37-8d6c-5e0b0cc6c4b6', '1471b666-1869-475f-92aa-f564b1192279', '63b1d6ae-6fe0-4790-b03b-f5d281c4f70c'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae31b69-7148-45d6-9c41-67e0375bb44c]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:35 devstack sudo[88214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:35 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-37bdf1f5-2756-498c-8150-3d9e30133d8e-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-37bdf1f5-2756-498c-8150-3d9e30133d8e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:35 devstack sudo[88216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:52:35 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-quobyte-37bdf1f5-2756-498c-8150-3d9e30133d8e" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-37bdf1f5-2756-498c-8150-3d9e30133d8e" acquired by "delete_volume" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d89d6c-a23e-406d-9a64-3dd847fb80a3]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-37bdf1f5-2756-498c-8150-3d9e30133d8e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:35 devstack sudo[88221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-37bdf1f5-2756-498c-8150-3d9e30133d8e
Apr 16 19:52:35 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:35 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc" returned: 0 in 0.571s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c2ca04-c5b8-4752-92e0-cb3676e20d7f]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:35 devstack sudo[88223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b
Apr 16 19:52:35 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:35 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599" returned: 0 in 0.720s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.480e288d-b9ba-4779-bd83-8594d5bf866esfb7s_v3.img {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:35 devstack sudo[88235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.480e288d-b9ba-4779-bd83-8594d5bf866esfb7s_v3.img
Apr 16 19:52:35 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:35 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.676s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:52:35 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Deleted volume successfully.
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-48206306-91d0-4055-810a-3c63563f23aa tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-cfcc7de2-a5f6-48d2-9009-df0c3556e1e0-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:35 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-37bdf1f5-2756-498c-8150-3d9e30133d8e" returned: 0 in 0.628s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-37bdf1f5-2756-498c-8150-3d9e30133d8e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:35 devstack sudo[88240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-37bdf1f5-2756-498c-8150-3d9e30133d8e
Apr 16 19:52:35 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:36 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b" returned: 0 in 0.614s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:36 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:52:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:36 devstack sudo[88242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc
Apr 16 19:52:36 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:36 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-37bdf1f5-2756-498c-8150-3d9e30133d8e" returned: 0 in 0.659s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-37bdf1f5-2756-498c-8150-3d9e30133d8e" released by "delete_volume" :: held 1.321s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:36 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Created reservations ['f8844966-be74-45eb-98ff-115765826587', '67be1d52-28cc-4e0d-aec5-baa055e30949', '6a047703-9b6c-4d38-a2ab-67a7f773a49f', '87101b81-8ef6-4094-8ee1-3e49a892b41f'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:36 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:36 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:36 devstack sudo[88257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:52:36 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:37 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc" returned: 0 in 1.531s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:37 devstack sudo[88262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc
Apr 16 19:52:37 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-584437f8-5eac-4b8e-9e73-bdb5d754d497-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-584437f8-5eac-4b8e-9e73-bdb5d754d497-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-quobyte-91e84431-af04-4142-8044-2eb8f6400f13" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-91e84431-af04-4142-8044-2eb8f6400f13" acquired by "delete_snapshot" :: waited 0.086s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-quobyte-584437f8-5eac-4b8e-9e73-bdb5d754d497" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-584437f8-5eac-4b8e-9e73-bdb5d754d497" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:37 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Deleting offline snapshot 584437f8-5eac-4b8e-9e73-bdb5d754d497 of volume 91e84431-af04-4142-8044-2eb8f6400f13 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:52:37 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] snapshot_file for this snap is: volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:52:37 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ead804-833b-4c9b-8a4a-7e250bdfce01]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:38 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.480e288d-b9ba-4779-bd83-8594d5bf866esfb7s_v3.img" returned: 0 in 2.145s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e92395-3e95-4ae0-a34a-0431f6b432d4]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:38 devstack sudo[88264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497
Apr 16 19:52:38 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:38 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 1.301s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:52:38 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Deleted volume successfully.
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-79a42b43-7f90-46c6-8032-d219733a03f0 tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-37bdf1f5-2756-498c-8150-3d9e30133d8e-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:38 devstack sudo[88266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599
Apr 16 19:52:38 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:38 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.b3528900-68ba-4277-ba4e-f1ad1347bfdc" returned: 0 in 0.704s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-b3528900-68ba-4277-ba4e-f1ad1347bfdc" released by "_delete_snapshot" :: held 3.472s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" released by "delete_snapshot" :: held 3.484s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Created reservations ['8841a459-7ad9-4c43-adf6-4bb6ee8c7acc', '0e7742b5-4de3-4620-bf37-526d1718b7db', 'fe22afc1-c204-4f97-862d-237b03665b3e', '80ffe8cc-6445-46ef-8957-95ae8277cd64'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:38 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Delete snapshot completed successfully.
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8be262d5-5cb8-48ae-9144-f30ae7129962 tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-b3528900-68ba-4277-ba4e-f1ad1347bfdc-delete_snapshot" released by "delete_snapshot" :: held 3.580s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:38 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497" returned: 0 in 0.561s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e84431-af04-4142-8044-2eb8f6400f13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a6dbe1-476f-48ae-bd32-101bf5de1511]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:38 devstack sudo[88275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13
Apr 16 19:52:38 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:38 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599" returned: 0 in 0.654s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.480e288d-b9ba-4779-bd83-8594d5bf866esfb7s_v3.img {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:52:38 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] Converted 1024.00 MB image at 474.34 MB/s
Apr 16 19:52:38 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] 480e288d-b9ba-4779-bd83-8594d5bf866e was raw, no need to convert to raw {{(pid=82616) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 16 19:52:39 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13" returned: 0 in 0.616s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:39 devstack sudo[88281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497
Apr 16 19:52:39 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:39 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497" returned: 0 in 0.562s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:39 devstack sudo[88286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497
Apr 16 19:52:39 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:40 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13.584437f8-5eac-4b8e-9e73-bdb5d754d497" returned: 0 in 0.581s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-584437f8-5eac-4b8e-9e73-bdb5d754d497" released by "_delete_snapshot" :: held 2.426s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-91e84431-af04-4142-8044-2eb8f6400f13" released by "delete_snapshot" :: held 2.484s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:40 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Created reservations ['94f026bd-09e5-4d8b-81f0-2bbb301c9871', '5328065a-b323-4ada-a528-afd8a12bbe86', '73eced20-6272-4eba-be9e-2e3584a29b3c', '033a620b-827f-49e1-a43d-9c298a148a7f'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:40 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Delete snapshot completed successfully.
Apr 16 19:52:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-93b1311d-8056-4767-bfc3-0b80afc9212d tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-584437f8-5eac-4b8e-9e73-bdb5d754d497-delete_snapshot" released by "delete_snapshot" :: held 2.706s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-91e84431-af04-4142-8044-2eb8f6400f13-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-91e84431-af04-4142-8044-2eb8f6400f13-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "cinder-quobyte-91e84431-af04-4142-8044-2eb8f6400f13" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-91e84431-af04-4142-8044-2eb8f6400f13" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:40 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c134fdc-8254-4fc7-a1de-ec34f2a84bb4]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:41 devstack sudo[88289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13
Apr 16 19:52:41 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:41 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13" returned: 0 in 0.639s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:41 devstack sudo[88295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13
Apr 16 19:52:41 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:42 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91e84431-af04-4142-8044-2eb8f6400f13" returned: 0 in 0.495s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-quobyte-91e84431-af04-4142-8044-2eb8f6400f13" released by "delete_volume" :: held 1.177s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:42 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Created reservations ['d3190413-6909-4fe7-8357-55045c1d31f2', '9e8071eb-cba7-4e9a-8ff6-22902f5e4c59', 'fafc2cf0-a29e-4bb4-92a3-93c8eb087d95', '645fef7f-fb79-4787-9903-461949ec0060'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:42 devstack sudo[88311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:52:42 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:42 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.507s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:42 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:52:42 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Deleted volume successfully.
Apr 16 19:52:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd27bd6e-3d44-4505-8a53-1c5bfb70c23c tempest-CreateVolumesFromSnapshotTest-30019624 None] Lock "cinder-91e84431-af04-4142-8044-2eb8f6400f13-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:45 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:52:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Flow 'volume_create_manager' (4494f522-3f2a-45af-b436-2384b853fd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82a8c45-f248-4a14-824e-d461940fac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82a8c45-f248-4a14-824e-d461940fac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1080936244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08668afd-5db4-4016-a7b6-8584a83ed3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26842060c67b456c9c6036bcfdb70463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:45Z,use_quota=True,user_id='3508c98ccf434455a9091d10c4495963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036f749f-d3cf-4c06-9316-53aea909f802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036f749f-d3cf-4c06-9316-53aea909f802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a65a42-c59a-4b09-b61c-be07fbd2b8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a65a42-c59a-4b09-b61c-be07fbd2b8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08668afd-5db4-4016-a7b6-8584a83ed3f8', 'volume_name': 'volume-08668afd-5db4-4016-a7b6-8584a83ed3f8', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71753691-152e-4484-9d0c-5b03fe8cd900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71753691-152e-4484-9d0c-5b03fe8cd900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c05109-f921-4e2d-bf28-f113c05d4e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:45 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Volume 08668afd-5db4-4016-a7b6-8584a83ed3f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08668afd-5db4-4016-a7b6-8584a83ed3f8', 'volume_size': 1}
Apr 16 19:52:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.384s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] Uploaded volume to glance image-id: 480e288d-b9ba-4779-bd83-8594d5bf866e. {{(pid=82616) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 16 19:52:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.684s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] Creating offline snapshot 011994ce-f8cc-43d2-a040-0b12ed35ac90 of volume ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:52:50 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b2e9a-85b8-4f02-957b-21c00f18f53b]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:50 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0ca2d3b1-7ea2-4c1c-ae28-d94140ae2aed tempest-VolumesActionsTest-1478275988 None] Copy volume to image completed successfully.
Apr 16 19:52:50 devstack sudo[88357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b
Apr 16 19:52:50 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:50 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b" returned: 0 in 0.625s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:52:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:50 devstack sudo[88380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90 1G
Apr 16 19:52:50 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:51 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90 1G" returned: 0 in 0.593s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:51 devstack sudo[88386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90
Apr 16 19:52:51 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:51 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90" returned: 0 in 0.510s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:51 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90 is being set with open permissions: ugo+rw
Apr 16 19:52:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:51 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90
Apr 16 19:52:51 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:52 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90" returned: 0 in 0.410s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.208s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.987s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1080936244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08668afd-5db4-4016-a7b6-8584a83ed3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26842060c67b456c9c6036bcfdb70463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:52:45Z,use_quota=True,user_id='3508c98ccf434455a9091d10c4495963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Creating volume 08668afd-5db4-4016-a7b6-8584a83ed3f8 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:52:52 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:52 devstack sudo[88395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 1073741824
Apr 16 19:52:52 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:52 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f45ebd92-4b31-4f97-92c0-68b2eda3c2cb tempest-SnapshotsActionsTest-1038725633 None] Create snapshot completed successfully
Apr 16 19:52:52 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 1073741824" returned: 0 in 0.560s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:52 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8
Apr 16 19:52:52 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Acquiring lock "cinder-011994ce-f8cc-43d2-a040-0b12ed35ac90-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-011994ce-f8cc-43d2-a040-0b12ed35ac90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Acquiring lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Acquiring lock "cinder-quobyte-011994ce-f8cc-43d2-a040-0b12ed35ac90" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-011994ce-f8cc-43d2-a040-0b12ed35ac90" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Deleting offline snapshot 011994ce-f8cc-43d2-a040-0b12ed35ac90 of volume ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] snapshot_file for this snap is: volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30287f2-06e5-4f2a-839b-f4629e669967]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:52 devstack sudo[88402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90
Apr 16 19:52:52 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:53 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8" returned: 0 in 0.477s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.173s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c05109-f921-4e2d-bf28-f113c05d4e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08668afd-5db4-4016-a7b6-8584a83ed3f8', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e0c80c-077d-4b27-be72-0ac3e86c7695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b69524-d0e2-4593-b4c9-e3d82be7a411]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:53 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Volume volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 (08668afd-5db4-4016-a7b6-8584a83ed3f8): created successfully
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e0c80c-077d-4b27-be72-0ac3e86c7695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Flow 'volume_create_manager' (4494f522-3f2a-45af-b436-2384b853fd9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:52:53 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-9096f4dd-c4cd-4cf8-a537-09fca722c4a7 tempest-VolumeDependencyTests-353969951 None] Created volume successfully.
Apr 16 19:52:53 devstack sudo[88405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599
Apr 16 19:52:53 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:53 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90" returned: 0 in 0.504s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19a5777-226c-41a0-a951-9caa7f0d89c9]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:53 devstack sudo[88410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b
Apr 16 19:52:53 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:53 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599" returned: 0 in 0.587s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c44357b-6569-4229-bba1-1b0d033a19af]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:53 devstack sudo[88415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599
Apr 16 19:52:53 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:54 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b" returned: 0 in 0.585s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:54 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:52:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:54 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90
Apr 16 19:52:54 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:54 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599" returned: 0 in 0.516s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:54 devstack sudo[88428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img
Apr 16 19:52:54 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:54 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90" returned: 0 in 0.503s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:54 devstack sudo[88430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90
Apr 16 19:52:54 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:55 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.011994ce-f8cc-43d2-a040-0b12ed35ac90" returned: 0 in 0.791s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-011994ce-f8cc-43d2-a040-0b12ed35ac90" released by "_delete_snapshot" :: held 2.449s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" released by "delete_snapshot" :: held 2.467s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:55 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Created reservations ['3b4e635a-2026-4660-8486-436ea34384b3', '157a89b7-0210-445f-b4ab-479a52ca19d5', 'a890c3a0-3cb8-4548-bf0f-00a45987baa6', '7dbbb93d-3905-4991-8e16-3128b4b96da2'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:52:55 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Delete snapshot completed successfully.
Apr 16 19:52:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0ff7ab3c-5bf2-47e6-b767-e7f39c679503 tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-011994ce-f8cc-43d2-a040-0b12ed35ac90-delete_snapshot" released by "delete_snapshot" :: held 2.746s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:52:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:52:56 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img" returned: 0 in 2.380s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:56 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[aead06fa-105e-4717-a8a6-9188055748a4]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:56 devstack sudo[88444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599
Apr 16 19:52:56 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:57 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599" returned: 0 in 0.685s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:57 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599, size 1024.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:52:57 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Converted 1024.00 MB image at 430.03 MB/s
Apr 16 19:52:57 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] 1866ef37-249f-4856-98c4-0d4210e6718e was raw, converting to qcow2 {{(pid=82616) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 16 19:52:57 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05a7bba-accd-4f1c-8453-285e19971881]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:57 devstack sudo[88449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img
Apr 16 19:52:57 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:58 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img" returned: 0 in 0.553s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:58 devstack sudo[88454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img
Apr 16 19:52:58 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:58 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img" returned: 1 in 0.507s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:52:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img /opt/stack/data/cinder/conversion/vol_upload_00xv7va7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:58 devstack sudo[88460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img /opt/stack/data/cinder/conversion/vol_upload_00xv7va7
Apr 16 19:52:58 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:59 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img /opt/stack/data/cinder/conversion/vol_upload_00xv7va7" returned: 0 in 0.475s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:52:59 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Image conversion details: src /opt/stack/data/cinder/conversion/4d11e7bf-3d3f-467c-9f62-99961cc75599.temp_image.1866ef37-249f-4856-98c4-0d4210e6718ex2wa13e6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_00xv7va7 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:52:59 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 16 19:52:59 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba939e4-fd97-4c32-97c5-801dfb95b985]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:52:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_00xv7va7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:52:59 devstack sudo[88465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_00xv7va7
Apr 16 19:52:59 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:52:59 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root
Apr 16 19:52:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_00xv7va7" returned: 0 in 0.496s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.266s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Uploaded volume to glance image-id: 1866ef37-249f-4856-98c4-0d4210e6718e. {{(pid=82616) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 16 19:53:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.844s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:00 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ac09fe43-a4f6-439b-a75d-c8f1fb4e65d0 tempest-VolumesActionsTest-1478275988 None] Copy volume to image completed successfully.
Apr 16 19:53:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Acquiring lock "cinder-afb59bac-1ba0-46db-a22f-2adc44c4734a-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] Creating offline snapshot ae268355-aa38-4170-aa05-d845d038a92e of volume 08668afd-5db4-4016-a7b6-8584a83ed3f8 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:53:00 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f225fde7-452d-4d2d-b826-0bbc716fd08d]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Lock "cinder-afb59bac-1ba0-46db-a22f-2adc44c4734a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Acquiring lock "cinder-quobyte-afb59bac-1ba0-46db-a22f-2adc44c4734a" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Lock "cinder-quobyte-afb59bac-1ba0-46db-a22f-2adc44c4734a" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:00 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aba1396-3074-4eff-80cc-2910b59190ef]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-afb59bac-1ba0-46db-a22f-2adc44c4734a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:00 devstack sudo[88470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8
Apr 16 19:53:00 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:00 devstack sudo[88471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-afb59bac-1ba0-46db-a22f-2adc44c4734a
Apr 16 19:53:00 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:01 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8" returned: 0 in 0.518s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:01 devstack sudo[88480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e 1G
Apr 16 19:53:01 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:01 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-afb59bac-1ba0-46db-a22f-2adc44c4734a" returned: 0 in 0.481s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-afb59bac-1ba0-46db-a22f-2adc44c4734a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:01 devstack sudo[88482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-afb59bac-1ba0-46db-a22f-2adc44c4734a
Apr 16 19:53:01 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:01 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-afb59bac-1ba0-46db-a22f-2adc44c4734a" returned: 0 in 0.440s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Lock "cinder-quobyte-afb59bac-1ba0-46db-a22f-2adc44c4734a" released by "delete_volume" :: held 0.943s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Created reservations ['2a66859d-77d8-461b-8505-a0fe36ac4e10', 'c849e6f6-4e18-47e4-8ff1-8aa3a89d94bf', 'bec6c7b4-1574-408a-9f85-70446f2e2e5c', '6238ccc4-05a8-49f7-8d80-fed44ce2b99a'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:01 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e 1G" returned: 0 in 0.554s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:01 devstack sudo[88488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e
Apr 16 19:53:01 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:01 devstack sudo[88490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:01 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Acquiring lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Acquiring lock "cinder-quobyte-4d11e7bf-3d3f-467c-9f62-99961cc75599" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Lock "cinder-quobyte-4d11e7bf-3d3f-467c-9f62-99961cc75599" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cd02d2-14e6-44d2-b8de-0ea6c1b8cf96]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:01 devstack sudo[88492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599
Apr 16 19:53:01 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:02 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.428s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:02 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Deleted volume successfully.
Apr 16 19:53:02 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-fa41d425-d417-4e4c-a35f-be3ca02a2512 tempest-VolumesNegativeTest-1661416955 None] Lock "cinder-afb59bac-1ba0-46db-a22f-2adc44c4734a-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e" returned: 0 in 0.493s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:02 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e is being set with open permissions: ugo+rw
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:02 devstack sudo[88498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e
Apr 16 19:53:02 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:02 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599" returned: 0 in 0.502s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:02 devstack sudo[88503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599
Apr 16 19:53:02 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:02 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e" returned: 0 in 0.409s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:02 devstack sudo[88506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.info
Apr 16 19:53:02 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:02 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d11e7bf-3d3f-467c-9f62-99961cc75599" returned: 0 in 0.476s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Lock "cinder-quobyte-4d11e7bf-3d3f-467c-9f62-99961cc75599" released by "delete_volume" :: held 1.010s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Created reservations ['0e01a357-755a-4d1f-a1b5-47e3e305ad5e', 'ddf1dda2-b598-4e18-8d21-6655bb7b105f', '19ffa7b3-e4b3-4bd7-a6a4-935ceb8e8045', '20946033-a5c7-471c-8e9b-39f8097a033b'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:02 devstack sudo[88510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:02 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:03 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.info" returned: 0 in 0.445s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:03 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.info is being set with open permissions: ugo+rw
Apr 16 19:53:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:03 devstack sudo[88512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.info
Apr 16 19:53:03 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:03 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.554s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:03 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:03 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Deleted volume successfully.
Apr 16 19:53:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2a4468ba-5166-43be-98f0-c9b546bba31e tempest-VolumesActionsTest-1478275988 None] Lock "cinder-4d11e7bf-3d3f-467c-9f62-99961cc75599-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:03 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.info" returned: 0 in 0.529s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.017s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.975s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] Creating offline snapshot 026ed6a2-36d4-4acf-b7e5-ce9c522cafd9 of volume ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:53:03 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1070f7b-29b7-40aa-afde-473ebed69638]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:03 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-8c75e0be-177b-49a4-b7f1-81343927adef tempest-VolumeDependencyTests-353969951 None] Create snapshot completed successfully
Apr 16 19:53:03 devstack sudo[88550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b
Apr 16 19:53:03 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:04 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b" returned: 0 in 0.573s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:04 devstack sudo[88555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9 1G
Apr 16 19:53:04 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Flow 'volume_create_manager' (444d6d24-ea57-4bbf-8ccf-4c6c0ab789f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccddc44-8375-4d0d-b44d-1c4ebd5f1cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccddc44-8375-4d0d-b44d-1c4ebd5f1cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1269596769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c938a2a-a4cc-401d-af85-8c86bc3e7b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26842060c67b456c9c6036bcfdb70463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ae268355-aa38-4170-aa05-d845d038a92e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:04Z,use_quota=True,user_id='3508c98ccf434455a9091d10c4495963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbeb5ac6-f114-4224-a047-103f1d8a88a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbeb5ac6-f114-4224-a047-103f1d8a88a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce13030b-aa53-447e-80dc-3ecaca95038c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce13030b-aa53-447e-80dc-3ecaca95038c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0c938a2a-a4cc-401d-af85-8c86bc3e7b29', 'volume_name': 'volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29', 'volume_size': 1, 'snapshot_id': 'ae268355-aa38-4170-aa05-d845d038a92e'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070c1eda-d7ee-4015-ae85-c69a28da0b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070c1eda-d7ee-4015-ae85-c69a28da0b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8110f03-5f78-4783-99d4-5b9a20c54cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:04 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Volume 0c938a2a-a4cc-401d-af85-8c86bc3e7b29: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29', 'volume_size': 1, 'snapshot_id': 'ae268355-aa38-4170-aa05-d845d038a92e'}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:04 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9 1G" returned: 0 in 0.725s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:04 devstack sudo[88561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9
Apr 16 19:53:04 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:05 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9" returned: 0 in 0.498s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:05 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9 is being set with open permissions: ugo+rw
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:05 devstack sudo[88567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9
Apr 16 19:53:05 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:05 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9" returned: 0 in 0.511s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.440s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-quobyte-ae268355-aa38-4170-aa05-d845d038a92e-0c938a2a-a4cc-401d-af85-8c86bc3e7b29" by "_create_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:05 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f0bfed91-2955-49d1-8457-1db25d196412 tempest-SnapshotsActionsTest-1038725633 None] Create snapshot completed successfully
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-ae268355-aa38-4170-aa05-d845d038a92e-0c938a2a-a4cc-401d-af85-8c86bc3e7b29" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Creating volume 0c938a2a-a4cc-401d-af85-8c86bc3e7b29 from snapshot ae268355-aa38-4170-aa05-d845d038a92e {{(pid=82616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-quobyte-0c938a2a-a4cc-401d-af85-8c86bc3e7b29" by "_copy_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-0c938a2a-a4cc-401d-af85-8c86bc3e7b29" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] snapshot: ae268355-aa38-4170-aa05-d845d038a92e, volume: 0c938a2a-a4cc-401d-af85-8c86bc3e7b29,  {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 19:53:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:06 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2300bbe5-31b4-462f-b8d6-623d109832ba]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:06 devstack sudo[88570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e
Apr 16 19:53:06 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:06 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e" returned: 0 in 0.591s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08668afd-5db4-4016-a7b6-8584a83ed3f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 19:53:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Creating direct copy from snapshot {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 19:53:06 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f686e04-9755-4511-8df6-3e37dcc644b6]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:06 devstack sudo[88575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8
Apr 16 19:53:06 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Acquiring lock "cinder-026ed6a2-36d4-4acf-b7e5-ce9c522cafd9-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-026ed6a2-36d4-4acf-b7e5-ce9c522cafd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Acquiring lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Acquiring lock "cinder-quobyte-026ed6a2-36d4-4acf-b7e5-ce9c522cafd9" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-026ed6a2-36d4-4acf-b7e5-ce9c522cafd9" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Deleting offline snapshot 026ed6a2-36d4-4acf-b7e5-ce9c522cafd9 of volume ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] snapshot_file for this snap is: volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e310d94a-063d-400d-b940-b4e834014389]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:07 devstack sudo[88578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9
Apr 16 19:53:07 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:07 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8" returned: 0 in 0.693s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG cinder.utils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Path /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29 not found in is_blk_device check {{(pid=82616) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:07 devstack sudo[88583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29
Apr 16 19:53:07 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:07 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9" returned: 0 in 0.585s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7379b696-f758-40c7-8735-a5125e536804]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:07 devstack sudo[88588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b
Apr 16 19:53:07 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:08 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b" returned: 0 in 1.050s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:08 devstack sudo[88607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9
Apr 16 19:53:08 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:09 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (3a9cbe4a-7889-40e5-b43a-1115db7f77f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e166d7f-229d-4991-a23b-367040828845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e166d7f-229d-4991-a23b-367040828845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1733002347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705ea8e5-9d7e-4afb-a419-08e99dd5b7f1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='18c6361144b541e0aeb112b8d6e8fdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:10Z,use_quota=True,user_id='beb43ad1c4b04aa591d3928ad16096a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7107d1b2-a479-46be-9ed2-5e87e0e08dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7107d1b2-a479-46be-9ed2-5e87e0e08dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a61ba3-24a8-4265-b874-bfbf57c7c3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a61ba3-24a8-4265-b874-bfbf57c7c3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '705ea8e5-9d7e-4afb-a419-08e99dd5b7f1', 'volume_name': 'volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f789bfa-fc30-47cb-bdbb-2631a751c8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f789bfa-fc30-47cb-bdbb-2631a751c8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1165857e-569d-4d1a-ad74-6c6b0a5396ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:10 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Volume 705ea8e5-9d7e-4afb-a419-08e99dd5b7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1', 'volume_size': 1}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:10 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29" returned: 0 in 2.768s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e51b324-5b05-4db5-a689-9e1fed24b9aa]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:10 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8
Apr 16 19:53:10 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:10 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9" returned: 0 in 1.512s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:10 devstack sudo[88614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9
Apr 16 19:53:10 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:10 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.026ed6a2-36d4-4acf-b7e5-ce9c522cafd9" returned: 0 in 0.434s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-026ed6a2-36d4-4acf-b7e5-ce9c522cafd9" released by "_delete_snapshot" :: held 3.648s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" released by "delete_snapshot" :: held 3.659s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Created reservations ['c4f4c93e-1564-4667-aa60-bc1db6692385', 'b7a1a184-e112-4281-a760-b32947312b1b', 'e04d8b26-b353-41d9-b286-4c8493dfac9e', '462b23ae-be59-482c-8af4-e78a386f6ba0'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:10 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8" returned: 0 in 0.722s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8, size 1024.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:53:10 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Converted 1024.00 MB image at 369.85 MB/s
Apr 16 19:53:10 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29 is being set with open permissions: ugo+rw
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:10 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Delete snapshot completed successfully.
Apr 16 19:53:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c47a018a-5220-4bb6-8ca8-33915c8431ea tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-026ed6a2-36d4-4acf-b7e5-ce9c522cafd9-delete_snapshot" released by "delete_snapshot" :: held 3.777s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:10 devstack sudo[88620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29
Apr 16 19:53:10 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:11 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29" returned: 0 in 0.477s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-0c938a2a-a4cc-401d-af85-8c86bc3e7b29" released by "_copy_volume_from_snapshot" :: held 5.324s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-ae268355-aa38-4170-aa05-d845d038a92e-0c938a2a-a4cc-401d-af85-8c86bc3e7b29" released by "_create_volume_from_snapshot" :: held 5.349s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.369s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.293s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1733002347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705ea8e5-9d7e-4afb-a419-08e99dd5b7f1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='18c6361144b541e0aeb112b8d6e8fdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:10Z,use_quota=True,user_id='beb43ad1c4b04aa591d3928ad16096a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Creating volume 705ea8e5-9d7e-4afb-a419-08e99dd5b7f1 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:53:11 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:11 devstack sudo[88624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1 1073741824
Apr 16 19:53:11 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8110f03-5f78-4783-99d4-5b9a20c54cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29', 'volume_size': 1, 'snapshot_id': 'ae268355-aa38-4170-aa05-d845d038a92e'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d309d81-6594-4426-a7a7-602f5e1a3e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:11 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Volume volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29 (0c938a2a-a4cc-401d-af85-8c86bc3e7b29): created successfully
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d309d81-6594-4426-a7a7-602f5e1a3e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Flow 'volume_create_manager' (444d6d24-ea57-4bbf-8ccf-4c6c0ab789f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:11 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f7482792-641d-4b75-93e9-f0f28a111fdf tempest-VolumeDependencyTests-353969951 None] Created volume successfully.
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_service.periodic_task [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82616) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:11 devstack sudo[88626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:11 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:11 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1 1073741824" returned: 0 in 0.627s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:12 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-ae268355-aa38-4170-aa05-d845d038a92e-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.516s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:12 devstack sudo[88632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-ae268355-aa38-4170-aa05-d845d038a92e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:12 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-quobyte-08668afd-5db4-4016-a7b6-8584a83ed3f8" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-08668afd-5db4-4016-a7b6-8584a83ed3f8" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-quobyte-ae268355-aa38-4170-aa05-d845d038a92e" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-ae268355-aa38-4170-aa05-d845d038a92e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Deleting offline snapshot ae268355-aa38-4170-aa05-d845d038a92e of volume 08668afd-5db4-4016-a7b6-8584a83ed3f8 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] snapshot_file for this snap is: volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deba42e-0cce-4799-98ef-c91425eaf083]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:12 devstack sudo[88634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e
Apr 16 19:53:12 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:12 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1" returned: 0 in 0.531s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.944s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1165857e-569d-4d1a-ad74-6c6b0a5396ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abf90c0-c220-43b4-8762-8ffd411dd1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] Creating offline snapshot 6a80ac44-a00d-4e75-8d5c-8cc96800d476 of volume ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:53:12 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Volume volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1 (705ea8e5-9d7e-4afb-a419-08e99dd5b7f1): created successfully
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abf90c0-c220-43b4-8762-8ffd411dd1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (3a9cbe4a-7889-40e5-b43a-1115db7f77f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[900c8345-7a35-4cc9-be57-c808346db877]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:12 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-9f2776cd-ac74-41be-b08b-6ba56e9ba068 tempest-VolumesGetTest-2085363863 None] Created volume successfully.
Apr 16 19:53:12 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e" returned: 0 in 0.619s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08668afd-5db4-4016-a7b6-8584a83ed3f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:12 devstack sudo[88640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b
Apr 16 19:53:12 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8b2262-4d0a-462a-945b-1dc5c3b36e71]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:12 devstack sudo[88642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8
Apr 16 19:53:12 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:13 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b" returned: 0 in 0.708s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:13 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476 1G
Apr 16 19:53:13 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:13 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (8a1b5711-8827-4bfd-ad76-b105522a1d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff732a4d-b4ce-4c31-b447-ce648fae7dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8" returned: 0 in 0.732s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff732a4d-b4ce-4c31-b447-ce648fae7dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1742299301',display_name='tempest-VolumesGetTest-Volume-380930218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227d6cb0-5b43-402e-89c6-fffbd808c279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c6361144b541e0aeb112b8d6e8fdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:13Z,use_quota=True,user_id='beb43ad1c4b04aa591d3928ad16096a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b934a9-6761-4c48-86f7-52d390ea0aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b934a9-6761-4c48-86f7-52d390ea0aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2b60e0-8021-462d-a952-f309feb56ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2b60e0-8021-462d-a952-f309feb56ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '227d6cb0-5b43-402e-89c6-fffbd808c279', 'volume_name': 'volume-227d6cb0-5b43-402e-89c6-fffbd808c279', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4838676-83f2-49d7-a685-3d929c7cfd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:13 devstack sudo[88652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e
Apr 16 19:53:13 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4838676-83f2-49d7-a685-3d929c7cfd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d3cd7d-9a09-464d-a625-e772958d72d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:13 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Volume 227d6cb0-5b43-402e-89c6-fffbd808c279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-227d6cb0-5b43-402e-89c6-fffbd808c279', 'volume_size': 1}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:13 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476 1G" returned: 0 in 0.666s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:13 devstack sudo[88660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476
Apr 16 19:53:13 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:14 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e" returned: 0 in 0.677s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:14 devstack sudo[88662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e
Apr 16 19:53:14 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Flow 'volume_create_manager' (a01f7ea5-5ea2-455e-983f-cfffae7e9d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c560573-88b2-44f2-8d42-b0fd63e6fcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c560573-88b2-44f2-8d42-b0fd63e6fcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-665244134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98d1d9b-421f-4e6b-a255-544c9c1b59bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f66bf9259c4f1ca1ae455ecded6c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:14Z,use_quota=True,user_id='e50db9f51e1d4d88a194ae765f631ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3faaba6-43a6-4095-a784-60a62aed6c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3faaba6-43a6-4095-a784-60a62aed6c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca953dcc-2f0e-45d0-a73d-fc17bdd38708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca953dcc-2f0e-45d0-a73d-fc17bdd38708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b98d1d9b-421f-4e6b-a255-544c9c1b59bf', 'volume_name': 'volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5fe6bc-9542-4774-a66c-da6699c67d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5fe6bc-9542-4774-a66c-da6699c67d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e661d7e4-4d86-4d87-ac5f-90b3dd247ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:14 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Volume b98d1d9b-421f-4e6b-a255-544c9c1b59bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf', 'volume_size': 1}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:14 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476" returned: 0 in 0.458s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:14 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476 is being set with open permissions: ugo+rw
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:14 devstack sudo[88667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476
Apr 16 19:53:14 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:14 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8.ae268355-aa38-4170-aa05-d845d038a92e" returned: 0 in 0.433s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-ae268355-aa38-4170-aa05-d845d038a92e" released by "_delete_snapshot" :: held 2.528s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-08668afd-5db4-4016-a7b6-8584a83ed3f8" released by "delete_snapshot" :: held 2.538s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Created reservations ['34fbc161-dd5d-45ce-9a7e-509a6d83a196', 'caa752dd-725e-4d86-940d-127d53b65097', '59243b02-6154-40c9-a7d8-2848907630e0', 'cf9d498e-6d20-4cff-9cde-6bfa5417a7f7'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:14 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Delete snapshot completed successfully.
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-40ed0ec0-63ee-4da8-8528-7dc63b71fa26 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-ae268355-aa38-4170-aa05-d845d038a92e-delete_snapshot" released by "delete_snapshot" :: held 2.621s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:14 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476" returned: 0 in 0.434s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.345s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.388s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1742299301',display_name='tempest-VolumesGetTest-Volume-380930218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227d6cb0-5b43-402e-89c6-fffbd808c279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c6361144b541e0aeb112b8d6e8fdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:13Z,use_quota=True,user_id='beb43ad1c4b04aa591d3928ad16096a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Creating volume 227d6cb0-5b43-402e-89c6-fffbd808c279 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:53:14 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:53:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-227d6cb0-5b43-402e-89c6-fffbd808c279 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:14 devstack sudo[88672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-227d6cb0-5b43-402e-89c6-fffbd808c279 1073741824
Apr 16 19:53:14 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:14 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-662176c3-7a5e-4eb6-817e-2b9b392fc922 tempest-SnapshotsActionsTest-1038725633 None] Create snapshot completed successfully
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-08668afd-5db4-4016-a7b6-8584a83ed3f8-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-08668afd-5db4-4016-a7b6-8584a83ed3f8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-quobyte-08668afd-5db4-4016-a7b6-8584a83ed3f8" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-08668afd-5db4-4016-a7b6-8584a83ed3f8" acquired by "delete_volume" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[143ac83d-106e-4a4b-8903-71491c63e90f]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:15 devstack sudo[88677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8
Apr 16 19:53:15 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:15 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-227d6cb0-5b43-402e-89c6-fffbd808c279 1073741824" returned: 0 in 0.492s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-227d6cb0-5b43-402e-89c6-fffbd808c279 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:15 devstack sudo[88679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-227d6cb0-5b43-402e-89c6-fffbd808c279
Apr 16 19:53:15 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:15 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8" returned: 0 in 0.528s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:15 devstack sudo[88685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8
Apr 16 19:53:15 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Acquiring lock "cinder-6a80ac44-a00d-4e75-8d5c-8cc96800d476-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:15 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-6a80ac44-a00d-4e75-8d5c-8cc96800d476-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Acquiring lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-227d6cb0-5b43-402e-89c6-fffbd808c279" returned: 0 in 0.437s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.604s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-665244134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98d1d9b-421f-4e6b-a255-544c9c1b59bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f66bf9259c4f1ca1ae455ecded6c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:14Z,use_quota=True,user_id='e50db9f51e1d4d88a194ae765f631ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Creating volume b98d1d9b-421f-4e6b-a255-544c9c1b59bf {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:53:15 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Acquiring lock "cinder-quobyte-6a80ac44-a00d-4e75-8d5c-8cc96800d476" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:15 devstack sudo[88687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf 1073741824
Apr 16 19:53:15 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d3cd7d-9a09-464d-a625-e772958d72d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-227d6cb0-5b43-402e-89c6-fffbd808c279', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf01473-1761-45de-b84c-bf7298e23197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:15 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Volume volume-227d6cb0-5b43-402e-89c6-fffbd808c279 (227d6cb0-5b43-402e-89c6-fffbd808c279): created successfully
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf01473-1761-45de-b84c-bf7298e23197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (8a1b5711-8827-4bfd-ad76-b105522a1d1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:15 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-fb1af1d5-f0ce-428d-9636-203415041892 tempest-VolumesGetTest-2085363863 None] Created volume successfully.
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-6a80ac44-a00d-4e75-8d5c-8cc96800d476" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Deleting offline snapshot 6a80ac44-a00d-4e75-8d5c-8cc96800d476 of volume ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] snapshot_file for this snap is: volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c4ef67-b95e-41c4-8ba8-b1ee19df9cca]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:15 devstack sudo[88689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476
Apr 16 19:53:15 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:16 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-08668afd-5db4-4016-a7b6-8584a83ed3f8" returned: 0 in 0.442s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-08668afd-5db4-4016-a7b6-8584a83ed3f8" released by "delete_volume" :: held 0.998s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Created reservations ['02344d03-49bf-4d6b-9615-49f8e14272e6', 'ebc31b8f-e933-4a4d-8cbc-e073312aa284', 'bdb53ec2-85c8-4307-a8b2-6d2bf5b1981f', '4c48b376-bc84-409e-b802-6b286e78e8d1'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:16 devstack sudo[88695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:16 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:16 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf 1073741824" returned: 0 in 0.567s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:16 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476" returned: 0 in 0.531s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:16 devstack sudo[88700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf
Apr 16 19:53:16 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f20901-6f67-4d7a-b3da-14304c239f2b]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:16 devstack sudo[88702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b
Apr 16 19:53:16 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-227d6cb0-5b43-402e-89c6-fffbd808c279-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Lock "cinder-227d6cb0-5b43-402e-89c6-fffbd808c279-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-quobyte-227d6cb0-5b43-402e-89c6-fffbd808c279" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-227d6cb0-5b43-402e-89c6-fffbd808c279" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d788e691-7c0f-45ed-a474-f5049afc2f88]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-227d6cb0-5b43-402e-89c6-fffbd808c279 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:16 devstack sudo[88704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-227d6cb0-5b43-402e-89c6-fffbd808c279
Apr 16 19:53:16 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:16 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.552s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:16 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Deleted volume successfully.
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ee1611e4-e404-44a7-bcea-077927cef992 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-08668afd-5db4-4016-a7b6-8584a83ed3f8-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:16 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf" returned: 0 in 0.494s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e661d7e4-4d86-4d87-ac5f-90b3dd247ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b6a0d8-d3cd-4948-8920-f55189c18e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:16 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Volume volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf (b98d1d9b-421f-4e6b-a255-544c9c1b59bf): created successfully
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b6a0d8-d3cd-4948-8920-f55189c18e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Flow 'volume_create_manager' (a01f7ea5-5ea2-455e-983f-cfffae7e9d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:16 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-aaf07531-b857-4968-9364-70503a09102f tempest-VolumesSnapshotTestJSON-1302484543 None] Created volume successfully.
Apr 16 19:53:16 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b" returned: 0 in 0.527s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:17 devstack sudo[88711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476
Apr 16 19:53:17 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:17 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-227d6cb0-5b43-402e-89c6-fffbd808c279" returned: 0 in 0.535s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-227d6cb0-5b43-402e-89c6-fffbd808c279 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:17 devstack sudo[88716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-227d6cb0-5b43-402e-89c6-fffbd808c279
Apr 16 19:53:17 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:17 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476" returned: 0 in 0.517s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] Creating offline snapshot 57521002-7aa2-441c-9cbe-a1231ca642a5 of volume b98d1d9b-421f-4e6b-a255-544c9c1b59bf {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:53:17 devstack sudo[88721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476
Apr 16 19:53:17 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfafa38a-cb3e-442b-9165-159e10578b25]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Flow 'volume_create_manager' (ad99d0ff-09bf-4beb-a8c6-9169b9c5ab83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb78608e-2039-4e08-ae1d-93d0681d4bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:17 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf
Apr 16 19:53:17 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb78608e-2039-4e08-ae1d-93d0681d4bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1828911909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5df5a98-cfcd-4031-bdd1-01490beb39f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26842060c67b456c9c6036bcfdb70463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:18Z,use_quota=True,user_id='3508c98ccf434455a9091d10c4495963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4654e6-53c3-4975-b489-89ebfb99c480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4654e6-53c3-4975-b489-89ebfb99c480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021e5f9c-d0c6-4358-9f7c-407f27b20e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021e5f9c-d0c6-4358-9f7c-407f27b20e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5df5a98-cfcd-4031-bdd1-01490beb39f1', 'volume_name': 'volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b5d9f9-5d6c-4d27-b933-45c56c4effea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b5d9f9-5d6c-4d27-b933-45c56c4effea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce102525-b9f1-4b66-9d07-2eb133ca845b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:17 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Volume b5df5a98-cfcd-4031-bdd1-01490beb39f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1', 'volume_size': 1}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:17 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-227d6cb0-5b43-402e-89c6-fffbd808c279" returned: 0 in 0.532s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-227d6cb0-5b43-402e-89c6-fffbd808c279" released by "delete_volume" :: held 1.087s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Created reservations ['352ffa5a-ab0b-4078-b3f7-bbd68ec0ca44', '88b0df76-04f3-4235-9250-ad558761e720', '5acbe8d7-420f-4145-b5d6-6ad346a34658', '7d812325-0827-4ab3-8a75-0a0cf8f10343'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:17 devstack sudo[88726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:17 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:17 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.6a80ac44-a00d-4e75-8d5c-8cc96800d476" returned: 0 in 0.452s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-6a80ac44-a00d-4e75-8d5c-8cc96800d476" released by "_delete_snapshot" :: held 2.080s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" released by "delete_snapshot" :: held 2.127s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Created reservations ['4f4acbf5-134f-4d5c-94b0-e779da674f18', 'a5953217-2a51-43ed-96f7-fb8b0afa3496', '8b0f26c8-0273-4144-ab44-1b5909c11eeb', '21396225-dcb2-4261-9e69-76d3c40a1164'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:18 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Delete snapshot completed successfully.
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ab69546f-9705-4a17-83ad-40332778308f tempest-SnapshotsActionsTest-132113155 None] Lock "cinder-6a80ac44-a00d-4e75-8d5c-8cc96800d476-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:18 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf" returned: 0 in 0.559s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:18 devstack sudo[88732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5 1G
Apr 16 19:53:18 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:18 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.440s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:18 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Deleted volume successfully.
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f5d3a977-ad42-4199-b952-cd0af485cc58 tempest-VolumesGetTest-2085363863 None] Lock "cinder-227d6cb0-5b43-402e-89c6-fffbd808c279-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:18 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5 1G" returned: 0 in 0.478s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:18 devstack sudo[88738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5
Apr 16 19:53:18 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Lock "cinder-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-quobyte-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a747567a-0b75-4c93-a444-410fbc17a468]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:19 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1
Apr 16 19:53:19 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:19 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5" returned: 0 in 0.532s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:19 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5 is being set with open permissions: ugo+rw
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:19 devstack sudo[88745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5
Apr 16 19:53:19 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Acquiring lock "cinder-8ff841b5-09de-406c-befa-d942b908d53b-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Lock "cinder-8ff841b5-09de-406c-befa-d942b908d53b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Acquiring lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Acquiring lock "cinder-quobyte-8ff841b5-09de-406c-befa-d942b908d53b" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Lock "cinder-quobyte-8ff841b5-09de-406c-befa-d942b908d53b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Deleting offline snapshot 8ff841b5-09de-406c-befa-d942b908d53b of volume ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] snapshot_file for this snap is: volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3a0922-cc9b-4df2-a15c-00ae103ee883]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:19 devstack sudo[88747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b
Apr 16 19:53:19 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:19 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1" returned: 0 in 0.578s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:19 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1
Apr 16 19:53:19 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:19 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5" returned: 0 in 0.455s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:19 devstack sudo[88755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.info
Apr 16 19:53:19 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:19 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b" returned: 0 in 0.494s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09726a3-ab22-4f8f-953d-6096f86da403]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:19 devstack sudo[88760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626
Apr 16 19:53:19 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:19 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1" returned: 0 in 0.438s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:19 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1" released by "delete_volume" :: held 1.039s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Created reservations ['ca3909d7-7188-4fe8-978f-4222470cf691', '79c47209-a248-46a9-85dc-3244161a7158', '36b7d84a-8f65-4ab2-a973-e6b3d3017a07', '603c756a-ea56-4473-b892-324313b3f773'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:20 devstack sudo[88764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:20 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:20 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.info" returned: 0 in 0.472s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:20 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.info is being set with open permissions: ugo+rw
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:20 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.info
Apr 16 19:53:20 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:20 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" returned: 0 in 0.510s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:20 devstack sudo[88771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b
Apr 16 19:53:20 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:20 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.430s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:20 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Deleted volume successfully.
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f034c4ac-5987-43c6-93d3-8601fd764490 tempest-VolumesGetTest-2085363863 None] Lock "cinder-705ea8e5-9d7e-4afb-a419-08e99dd5b7f1-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:20 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.info" returned: 0 in 0.415s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.980s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.800s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1828911909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5df5a98-cfcd-4031-bdd1-01490beb39f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26842060c67b456c9c6036bcfdb70463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:18Z,use_quota=True,user_id='3508c98ccf434455a9091d10c4495963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Creating volume b5df5a98-cfcd-4031-bdd1-01490beb39f1 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:53:20 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:20 devstack sudo[88775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 1073741824
Apr 16 19:53:20 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:UPDATE=201,cinder:INSERT=45,cinder:SELECT=149,cinder:DELETE=17 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:53:20 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-42f57868-dbb7-438a-867e-c28cc884805d tempest-VolumesSnapshotTestJSON-1302484543 None] Create snapshot completed successfully
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-57521002-7aa2-441c-9cbe-a1231ca642a5-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-57521002-7aa2-441c-9cbe-a1231ca642a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-b98d1d9b-421f-4e6b-a255-544c9c1b59bf" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-b98d1d9b-421f-4e6b-a255-544c9c1b59bf" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-57521002-7aa2-441c-9cbe-a1231ca642a5" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-57521002-7aa2-441c-9cbe-a1231ca642a5" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Deleting offline snapshot 57521002-7aa2-441c-9cbe-a1231ca642a5 of volume b98d1d9b-421f-4e6b-a255-544c9c1b59bf {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] snapshot_file for this snap is: volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9716d87d-4e1e-4351-9316-508082e45bf7]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:20 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b" returned: 0 in 0.520s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:20 devstack sudo[88781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b
Apr 16 19:53:20 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:20 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5
Apr 16 19:53:20 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:21 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 1073741824" returned: 0 in 0.528s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:21 devstack sudo[88787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1
Apr 16 19:53:21 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (143a6cdc-75bb-4513-8c47-66734274cc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478c845e-5e2d-4ba8-b9ab-960d816df215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478c845e-5e2d-4ba8-b9ab-960d816df215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1519648521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41a7c2d-6854-40bc-876c-75651fdbbfd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c6361144b541e0aeb112b8d6e8fdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:21Z,use_quota=True,user_id='beb43ad1c4b04aa591d3928ad16096a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2acf8a-8572-4d85-9fcb-b33de09a5b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2acf8a-8572-4d85-9fcb-b33de09a5b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10349317-66ad-461a-91db-df8f36bf6cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10349317-66ad-461a-91db-df8f36bf6cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd41a7c2d-6854-40bc-876c-75651fdbbfd1', 'volume_name': 'volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55301489-efc7-4829-93f7-4affd86313c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55301489-efc7-4829-93f7-4affd86313c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:21 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1634777-8799-4287-a94c-abe0b0eea69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:21 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Volume d41a7c2d-6854-40bc-876c-75651fdbbfd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1', 'volume_size': 1}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5" returned: 0 in 0.560s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[547ca068-afc5-467d-a9e5-9300e2f6548a]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:21 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626.8ff841b5-09de-406c-befa-d942b908d53b" returned: 0 in 0.542s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Lock "cinder-quobyte-8ff841b5-09de-406c-befa-d942b908d53b" released by "_delete_snapshot" :: held 2.123s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" released by "delete_snapshot" :: held 2.136s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:21 devstack sudo[88793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf
Apr 16 19:53:21 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Created reservations ['4a0b650a-82f9-4033-a1f3-2e3207896d49', '715deb48-d8c7-4352-9640-09c7cffc347c', '30bf6847-7c05-4fdf-9a31-b741aa04abb6', 'e08579e3-3b15-4fd2-961c-9ac934bd1dc4'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:21 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Delete snapshot completed successfully.
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef78632e-5406-4883-9d52-99277607a5da tempest-SnapshotsActionsTest-1038725633 None] Lock "cinder-8ff841b5-09de-406c-befa-d942b908d53b-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:21 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1" returned: 0 in 0.467s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.172s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1519648521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41a7c2d-6854-40bc-876c-75651fdbbfd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c6361144b541e0aeb112b8d6e8fdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:21Z,use_quota=True,user_id='beb43ad1c4b04aa591d3928ad16096a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Creating volume d41a7c2d-6854-40bc-876c-75651fdbbfd1 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:53:21 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce102525-b9f1-4b66-9d07-2eb133ca845b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5dc3cd-c1ef-4978-948c-e1d4d654c72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:21 devstack sudo[88796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 1073741824
Apr 16 19:53:21 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:21 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Volume volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 (b5df5a98-cfcd-4031-bdd1-01490beb39f1): created successfully
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5dc3cd-c1ef-4978-948c-e1d4d654c72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Flow 'volume_create_manager' (ad99d0ff-09bf-4beb-a8c6-9169b9c5ab83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:21 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-db9c39c3-ccde-4a68-832b-862a879a57ab tempest-VolumeDependencyTests-353969951 None] Created volume successfully.
Apr 16 19:53:21 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf" returned: 0 in 0.545s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:21 devstack sudo[88804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5
Apr 16 19:53:21 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:22 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 1073741824" returned: 0 in 0.524s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:22 devstack sudo[88806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1
Apr 16 19:53:22 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Flow 'volume_create_manager' (8a57f6cd-af21-4159-adfa-6449857facf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d259ec-7409-4fae-a9bd-cada52a6f72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d259ec-7409-4fae-a9bd-cada52a6f72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1598952738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635b66d3-af97-418a-a97f-daca7b996846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26842060c67b456c9c6036bcfdb70463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=b5df5a98-cfcd-4031-bdd1-01490beb39f1,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:22Z,use_quota=True,user_id='3508c98ccf434455a9091d10c4495963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9535a6e-36b1-4cab-8abc-f7015d850ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9535a6e-36b1-4cab-8abc-f7015d850ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42f6880-c886-402d-a3a2-7fe4c8b36be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42f6880-c886-402d-a3a2-7fe4c8b36be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '635b66d3-af97-418a-a97f-daca7b996846', 'volume_name': 'volume-635b66d3-af97-418a-a97f-daca7b996846', 'volume_size': 1, 'source_volid': 'b5df5a98-cfcd-4031-bdd1-01490beb39f1', 'source_volstatus': 'available'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44225cf-516b-49aa-a035-3ff0f55e86a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44225cf-516b-49aa-a035-3ff0f55e86a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d555b6b-29d1-4450-ad61-54f55e587481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:22 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Volume 635b66d3-af97-418a-a97f-daca7b996846: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-635b66d3-af97-418a-a97f-daca7b996846', 'volume_size': 1, 'source_volid': 'b5df5a98-cfcd-4031-bdd1-01490beb39f1', 'source_volstatus': 'available'}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:22 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5" returned: 0 in 0.516s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Acquiring lock "cinder-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:22 devstack sudo[88811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5
Apr 16 19:53:22 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Lock "cinder-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Acquiring lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[052d8a49-dfc5-4cd0-adff-d1106005b54f]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:22 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1" returned: 0 in 0.487s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.357s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:22 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Cloning volume b5df5a98-cfcd-4031-bdd1-01490beb39f1 to volume 635b66d3-af97-418a-a97f-daca7b996846
Apr 16 19:53:22 devstack sudo[88814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626
Apr 16 19:53:22 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1634777-8799-4287-a94c-abe0b0eea69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51dcd923-c72f-45b9-9219-bf6ac6cb08e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:22 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Volume volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 (d41a7c2d-6854-40bc-876c-75651fdbbfd1): created successfully
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51dcd923-c72f-45b9-9219-bf6ac6cb08e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (143a6cdc-75bb-4513-8c47-66734274cc9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Creating offline snapshot bcb94b64-f056-4006-a9c6-d4678c14f0a4 of volume b5df5a98-cfcd-4031-bdd1-01490beb39f1 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:53:22 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ba2c5f76-41b1-4dc8-bac1-9061e3d45a90 tempest-VolumesGetTest-2085363863 None] Created volume successfully.
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57e772d-8423-40e3-b648-a7d88df4d3c8]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:22 devstack sudo[88816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1
Apr 16 19:53:22 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:22 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf.57521002-7aa2-441c-9cbe-a1231ca642a5" returned: 0 in 0.460s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:DELETE=15,cinder:INSERT=52,cinder:SELECT=168,cinder:UPDATE=190 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-57521002-7aa2-441c-9cbe-a1231ca642a5" released by "_delete_snapshot" :: held 2.134s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-b98d1d9b-421f-4e6b-a255-544c9c1b59bf" released by "delete_snapshot" :: held 2.145s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:22 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Created reservations ['00f36967-638c-4b77-bd44-e4a5d16b91c8', 'ec405576-8801-4dc3-adcb-a7bf5b6b2fc3', '88debbff-a97d-4d1a-9df6-f71db9532cf7', '2526e7b9-e1fa-49f8-a1d6-1f3341446793'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:23 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Delete snapshot completed successfully.
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6e77cc87-dc40-4571-9d95-acf7825ecc34 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-57521002-7aa2-441c-9cbe-a1231ca642a5-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:23 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" returned: 0 in 0.490s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:23 devstack sudo[88822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626
Apr 16 19:53:23 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:23 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1" returned: 0 in 0.511s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:23 devstack sudo[88827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4 1G
Apr 16 19:53:23 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:23 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" returned: 0 in 0.413s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Lock "cinder-quobyte-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626" released by "delete_volume" :: held 0.930s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Created reservations ['1ce63be9-4c36-47b4-846b-b2f1147b82d1', '687a1754-0fdd-45d3-82b8-281fb8a055be', '928738f2-6bca-49fc-a697-aeedd129769a', 'b1a08418-6403-4b51-bf60-b21e6209a7d8'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:23 devstack sudo[88832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:23 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:23 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4 1G" returned: 0 in 0.544s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:23 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4
Apr 16 19:53:23 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (6bc23c79-0879-4065-b3ce-f947370ce60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecd8c39-39f7-44b2-8684-48c79d7ca7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecd8c39-39f7-44b2-8684-48c79d7ca7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2101406821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fe3a17-6403-44aa-8a58-4fd568dd6d60,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='18c6361144b541e0aeb112b8d6e8fdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=d41a7c2d-6854-40bc-876c-75651fdbbfd1,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:24Z,use_quota=True,user_id='beb43ad1c4b04aa591d3928ad16096a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7693019f-22b7-45ef-b467-020b88f4f50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7693019f-22b7-45ef-b467-020b88f4f50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9c29e1-8ff9-4e35-9125-e9d1c51a6cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9c29e1-8ff9-4e35-9125-e9d1c51a6cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b1fe3a17-6403-44aa-8a58-4fd568dd6d60', 'volume_name': 'volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60', 'volume_size': 1, 'source_volid': 'd41a7c2d-6854-40bc-876c-75651fdbbfd1', 'source_volstatus': 'available'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d03b86a-4331-4173-90ff-5a17a0c742a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d03b86a-4331-4173-90ff-5a17a0c742a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da749b1-99ce-4a03-8326-62f4bee12b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:23 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Volume b1fe3a17-6403-44aa-8a58-4fd568dd6d60: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60', 'volume_size': 1, 'source_volid': 'd41a7c2d-6854-40bc-876c-75651fdbbfd1', 'source_volstatus': 'available'}
Apr 16 19:53:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:24 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.541s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:24 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Deleted volume successfully.
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-da6e909a-c5e5-4891-8d3d-f75c7d2f87db tempest-SnapshotsActionsTest-1038725633 None] Lock "cinder-ffbe0a8c-d5f2-42a0-bff6-4eb6843e1626-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Flow 'volume_create_manager' (042fa2e6-4aae-4721-93d2-58da12a4f703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7b4eaf-a46e-40aa-a0ed-0cd1abb160e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:24 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7b4eaf-a46e-40aa-a0ed-0cd1abb160e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1236189827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe39420b-8a35-4d64-912f-b742bd1d42ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f66bf9259c4f1ca1ae455ecded6c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:24Z,use_quota=True,user_id='e50db9f51e1d4d88a194ae765f631ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8664a2b6-c671-4772-9356-f311f39e03be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8664a2b6-c671-4772-9356-f311f39e03be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39db6cef-5d0b-4abc-8e6a-3aa339b3fcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39db6cef-5d0b-4abc-8e6a-3aa339b3fcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe39420b-8a35-4d64-912f-b742bd1d42ea', 'volume_name': 'volume-fe39420b-8a35-4d64-912f-b742bd1d42ea', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25c5dd6-d112-4bea-8a9d-12b62fed1e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25c5dd6-d112-4bea-8a9d-12b62fed1e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17490991-9b3e-4954-9594-29c860e1616d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:24 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Volume fe39420b-8a35-4d64-912f-b742bd1d42ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe39420b-8a35-4d64-912f-b742bd1d42ea', 'volume_size': 1}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4" returned: 0 in 0.565s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:24 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4 is being set with open permissions: ugo+rw
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:24 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4
Apr 16 19:53:24 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:24 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4" returned: 0 in 0.507s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:24 devstack sudo[88846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.info
Apr 16 19:53:24 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:25 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.info" returned: 0 in 0.486s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:25 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.info is being set with open permissions: ugo+rw
Apr 16 19:53:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:25 devstack sudo[88849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.info
Apr 16 19:53:25 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:25 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.info" returned: 0 in 0.491s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-quobyte-635b66d3-af97-418a-a97f-daca7b996846" by "_copy_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-635b66d3-af97-418a-a97f-daca7b996846" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] snapshot: bcb94b64-f056-4006-a9c6-d4678c14f0a4, volume: 635b66d3-af97-418a-a97f-daca7b996846,  {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 19:53:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:25 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c7d251-b7d5-4195-8bd6-c719e5d89fb2]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:25 devstack sudo[88852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4
Apr 16 19:53:25 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:26 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4" returned: 0 in 0.521s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 19:53:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Creating direct copy from snapshot {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 19:53:26 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeae899-0caf-4194-98c4-20f93ede5b6c]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:26 devstack sudo[88857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1
Apr 16 19:53:26 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:26 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1" returned: 0 in 0.521s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:26 devstack cinder-volume[82616]: DEBUG cinder.utils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Path /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846 not found in is_blk_device check {{(pid=82616) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 19:53:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:26 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846
Apr 16 19:53:26 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:29 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846" returned: 0 in 2.410s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:29 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72790dd-5c9b-4b23-9904-03a2175ea73d]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:29 devstack sudo[88874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1
Apr 16 19:53:29 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:30 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1" returned: 0 in 0.720s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:30 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1, size 1024.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:53:30 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Converted 1024.00 MB image at 424.67 MB/s
Apr 16 19:53:30 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846 is being set with open permissions: ugo+rw
Apr 16 19:53:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:30 devstack sudo[88880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846
Apr 16 19:53:30 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:30 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846" returned: 0 in 0.436s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-635b66d3-af97-418a-a97f-daca7b996846" released by "_copy_volume_from_snapshot" :: held 4.659s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-quobyte-bcb94b64-f056-4006-a9c6-d4678c14f0a4" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-bcb94b64-f056-4006-a9c6-d4678c14f0a4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Deleting offline snapshot bcb94b64-f056-4006-a9c6-d4678c14f0a4 of volume b5df5a98-cfcd-4031-bdd1-01490beb39f1 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:53:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] snapshot_file for this snap is: volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:53:30 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd89b26-6d2e-41ec-826e-89dcf9a9e36a]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:30 devstack sudo[88883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4
Apr 16 19:53:30 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:31 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4" returned: 0 in 0.487s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:31 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:31 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4ec68d-d8aa-48e2-98c1-d98cacd1b7ff]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:31 devstack sudo[88894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1
Apr 16 19:53:31 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:31 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1" returned: 0 in 0.558s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:31 devstack sudo[88899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4
Apr 16 19:53:31 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:32 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4" returned: 0 in 0.526s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:32 devstack sudo[88904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4
Apr 16 19:53:32 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:32 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1.bcb94b64-f056-4006-a9c6-d4678c14f0a4" returned: 0 in 0.529s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:32 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-bcb94b64-f056-4006-a9c6-d4678c14f0a4" released by "_delete_snapshot" :: held 2.157s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.084s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.798s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:32 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Cloning volume d41a7c2d-6854-40bc-876c-75651fdbbfd1 to volume b1fe3a17-6403-44aa-8a58-4fd568dd6d60
Apr 16 19:53:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d555b6b-29d1-4450-ad61-54f55e587481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635b66d3-af97-418a-a97f-daca7b996846', 'volume_size': 1, 'source_volid': 'b5df5a98-cfcd-4031-bdd1-01490beb39f1', 'source_volstatus': 'available'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25683662-8b93-4c76-b0c3-7525ca90f2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Creating offline snapshot 8435b080-1da3-4f08-ad2e-a0d060e95de7 of volume d41a7c2d-6854-40bc-876c-75651fdbbfd1 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:53:32 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Volume volume-635b66d3-af97-418a-a97f-daca7b996846 (635b66d3-af97-418a-a97f-daca7b996846): created successfully
Apr 16 19:53:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25683662-8b93-4c76-b0c3-7525ca90f2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Flow 'volume_create_manager' (8a57f6cd-af21-4159-adfa-6449857facf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:32 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[25db4bf8-dfd7-4b0e-9189-f961e8400ae6]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:32 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f9cfb0bf-632c-4118-b612-d7c38b5c092c tempest-VolumeDependencyTests-353969951 None] Created volume successfully.
Apr 16 19:53:32 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1
Apr 16 19:53:32 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:33 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1" returned: 0 in 0.515s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:33 devstack sudo[88912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7 1G
Apr 16 19:53:33 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:33 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7 1G" returned: 0 in 0.523s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:33 devstack sudo[88917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7
Apr 16 19:53:33 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-b5df5a98-cfcd-4031-bdd1-01490beb39f1-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-b5df5a98-cfcd-4031-bdd1-01490beb39f1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-quobyte-b5df5a98-cfcd-4031-bdd1-01490beb39f1" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-b5df5a98-cfcd-4031-bdd1-01490beb39f1" acquired by "delete_volume" :: waited 0.006s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:33 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85a1dda-0d2e-4eb5-93b5-44e11c5f3f07]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:34 devstack sudo[88919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1
Apr 16 19:53:34 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:34 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7" returned: 0 in 0.519s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:34 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7 is being set with open permissions: ugo+rw
Apr 16 19:53:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:34 devstack sudo[88924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7
Apr 16 19:53:34 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:34 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1" returned: 0 in 0.541s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:34 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1
Apr 16 19:53:34 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:34 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7" returned: 0 in 0.472s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:34 devstack sudo[88933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.info
Apr 16 19:53:34 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:35 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b5df5a98-cfcd-4031-bdd1-01490beb39f1" returned: 0 in 0.576s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-b5df5a98-cfcd-4031-bdd1-01490beb39f1" released by "delete_volume" :: held 1.149s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Created reservations ['43cf21a6-29df-46ea-a561-a578bbc69430', 'e9653d1a-b54f-4027-bc70-f25ecc50505f', '3a5daa4d-6861-45c9-b0a1-9db0e125a072', '8da66268-ae87-45e9-9a83-aca2e143cd4d'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:35 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:35 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:35 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.info" returned: 0 in 0.513s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:35 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.info is being set with open permissions: ugo+rw
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:35 devstack sudo[88939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.info
Apr 16 19:53:35 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:35 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.530s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:35 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Deleted volume successfully.
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-310108cb-b1fd-44d9-a488-9aa0032e3294 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-b5df5a98-cfcd-4031-bdd1-01490beb39f1-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:35 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.info" returned: 0 in 0.468s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-quobyte-b1fe3a17-6403-44aa-8a58-4fd568dd6d60" by "_copy_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-b1fe3a17-6403-44aa-8a58-4fd568dd6d60" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] snapshot: 8435b080-1da3-4f08-ad2e-a0d060e95de7, volume: b1fe3a17-6403-44aa-8a58-4fd568dd6d60,  {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16c7527-4f0c-433f-8481-4b9ee11b816d]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:35 devstack sudo[88943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7
Apr 16 19:53:35 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-635b66d3-af97-418a-a97f-daca7b996846-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-635b66d3-af97-418a-a97f-daca7b996846-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-quobyte-635b66d3-af97-418a-a97f-daca7b996846" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-635b66d3-af97-418a-a97f-daca7b996846" acquired by "delete_volume" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1406e9f-0c26-4b25-9bb0-f2a173aa31d0]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:36 devstack sudo[88945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846
Apr 16 19:53:36 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:36 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7" returned: 0 in 0.588s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Creating direct copy from snapshot {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde5f27f-417d-4b69-abbf-96414945f604]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:36 devstack sudo[88950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1
Apr 16 19:53:36 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:36 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846" returned: 0 in 0.510s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:36 devstack sudo[88955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846
Apr 16 19:53:36 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:37 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1" returned: 0 in 0.645s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:37 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG cinder.utils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Path /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60 not found in is_blk_device check {{(pid=82616) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-635b66d3-af97-418a-a97f-daca7b996846" returned: 0 in 0.451s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-635b66d3-af97-418a-a97f-daca7b996846" released by "delete_volume" :: held 0.988s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:37 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60
Apr 16 19:53:37 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Created reservations ['d1d48eea-4bdb-46f6-901d-9983ed2ce16d', '3dcbe09e-a17e-4a30-8f99-503c7529a8f2', 'e98c9193-94ea-45f9-8a10-8c8bfc506853', '0552a1a2-056d-499d-9fe6-2a3321b5054e'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:37 devstack sudo[88963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:37 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:37 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.503s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:37 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Deleted volume successfully.
Apr 16 19:53:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1eed238a-8c47-4c0d-bcd4-e2ac90e8abb2 tempest-VolumeDependencyTests-353969951 None] Lock "cinder-635b66d3-af97-418a-a97f-daca7b996846-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-0c938a2a-a4cc-401d-af85-8c86bc3e7b29-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Lock "cinder-0c938a2a-a4cc-401d-af85-8c86bc3e7b29-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Acquiring lock "cinder-quobyte-0c938a2a-a4cc-401d-af85-8c86bc3e7b29" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-0c938a2a-a4cc-401d-af85-8c86bc3e7b29" acquired by "delete_volume" :: waited 0.028s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:38 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df86bdc-ad40-4c46-beb4-d65464f6b8cb]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:38 devstack sudo[88976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29
Apr 16 19:53:38 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:39 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60" returned: 0 in 2.529s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:39 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[343220e3-eb68-49fe-9480-154af9a1901d]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:39 devstack sudo[88980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1
Apr 16 19:53:39 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:39 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29" returned: 0 in 1.043s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:39 devstack sudo[88983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29
Apr 16 19:53:39 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:40 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0c938a2a-a4cc-401d-af85-8c86bc3e7b29" returned: 0 in 0.437s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Lock "cinder-quobyte-0c938a2a-a4cc-401d-af85-8c86bc3e7b29" released by "delete_volume" :: held 1.534s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Flow 'volume_create_manager' (01f1ae5f-e317-45d2-af0f-d678aee3e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fae2d73-7a2f-4034-b3bb-2c37944bedbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Created reservations ['c815097a-5fd5-4831-bc18-0b0abe5060f6', '55afbb29-c2ed-4d8d-a998-e4b9ffd0480a', '114b1360-1350-4a98-8a79-2d2fbf31adb4', 'b89992f4-ecfc-4145-a3d8-3c5720bbbdaa'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fae2d73-7a2f-4034-b3bb-2c37944bedbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-727293870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07e0322-b4ca-4436-b062-b1bbfdf64a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78f8e51866f4471970271bbb6a649d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:40Z,use_quota=True,user_id='c90a6582aa9d4f32bc8903193fe97cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a025d6-4161-4550-bb23-10495044365c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a025d6-4161-4550-bb23-10495044365c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (113d732d-47e6-44ed-bda2-ce53e30b1e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.image.glance [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Creating Keystone auth plugin from conf {{(pid=82616) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:40 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1" returned: 0 in 0.733s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:53:40 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Converted 1024.00 MB image at 404.68 MB/s
Apr 16 19:53:40 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60 is being set with open permissions: ugo+rw
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:40 devstack sudo[88989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:40 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:40 devstack sudo[88990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60
Apr 16 19:53:40 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (113d732d-47e6-44ed-bda2-ce53e30b1e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd07e0322-b4ca-4436-b062-b1bbfdf64a99', 'volume_name': 'volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99', 'volume_size': 1, 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94595a210065472391c483fcf54511ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'created_at': datetime.datetime(2026, 4, 16, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa3631dd150>}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3affd15e-2ccb-4ac8-b2e7-eeb123652318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3affd15e-2ccb-4ac8-b2e7-eeb123652318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72772be2-3c21-4f5b-90f4-58efbeb6f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:40 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Volume d07e0322-b4ca-4436-b062-b1bbfdf64a99: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99', 'volume_size': 1, 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94595a210065472391c483fcf54511ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'created_at': datetime.datetime(2026, 4, 16, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa3631dd150>}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Trying to clone d07e0322-b4ca-4436-b062-b1bbfdf64a99 from image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]). {{(pid=82616) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82616) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 16 19:53:40 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Image download 20.69 MB at 20.69 MB/s
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b7d186-b048-433e-b9b7-7609fe288375]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:40 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60" returned: 0 in 0.453s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-b1fe3a17-6403-44aa-8a58-4fd568dd6d60" released by "_copy_volume_from_snapshot" :: held 5.000s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:40 devstack sudo[88995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD
Apr 16 19:53:40 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-quobyte-8435b080-1da3-4f08-ad2e-a0d060e95de7" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-8435b080-1da3-4f08-ad2e-a0d060e95de7" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Deleting offline snapshot 8435b080-1da3-4f08-ad2e-a0d060e95de7 of volume d41a7c2d-6854-40bc-876c-75651fdbbfd1 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] snapshot_file for this snap is: volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:53:40 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.510s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:40 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Deleted volume successfully.
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a96847b-4feb-4fca-9cc0-4d111cf9ca66]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-29e6cb84-b85a-43cc-883a-e66adeebbd9d tempest-VolumeDependencyTests-353969951 None] Lock "cinder-0c938a2a-a4cc-401d-af85-8c86bc3e7b29-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:40 devstack sudo[88998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7
Apr 16 19:53:40 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:41 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD" returned: 0 in 0.541s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:41 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Temporary image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e is fetched for user c90a6582aa9d4f32bc8903193fe97cc9. {{(pid=82616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 16 19:53:41 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee063cbf-fdd7-422c-a18d-a58570b0fc78]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:41 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD
Apr 16 19:53:41 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:41 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7" returned: 0 in 0.566s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:41 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e11c88-c1cb-4b33-bd94-4e4e59346e98]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:41 devstack sudo[89008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1
Apr 16 19:53:41 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:41 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD" returned: 0 in 0.551s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:41 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1" returned: 0 in 0.560s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:42 devstack sudo[89016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7
Apr 16 19:53:42 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:42 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7" returned: 0 in 0.566s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:42 devstack sudo[89021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7
Apr 16 19:53:42 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Flow 'volume_create_manager' (4cbc4184-f670-4b20-af69-0bf6b117ca68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3201108-b8d5-4c7e-89d1-b27e8701fa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3201108-b8d5-4c7e-89d1-b27e8701fa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541be004-0a69-4a62-a785-ba608c74f4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ba9b73508740189fa604a5ebf5d4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:43Z,use_quota=True,user_id='bb5c8d54b2f8482cb600d88aee8cb68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335fe96e-511a-4caf-a692-5498a96264d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335fe96e-511a-4caf-a692-5498a96264d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d8ba83-3ff1-4fac-9539-e0b8918da157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d8ba83-3ff1-4fac-9539-e0b8918da157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '541be004-0a69-4a62-a785-ba608c74f4a2', 'volume_name': 'volume-541be004-0a69-4a62-a785-ba608c74f4a2', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417fa3ab-7b8f-4664-99d2-eef07373b382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417fa3ab-7b8f-4664-99d2-eef07373b382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225e6cf0-8fbd-4acb-b943-82cf4e6ff94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:42 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Volume 541be004-0a69-4a62-a785-ba608c74f4a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-541be004-0a69-4a62-a785-ba608c74f4a2', 'volume_size': 1}
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:42 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1.8435b080-1da3-4f08-ad2e-a0d060e95de7" returned: 0 in 0.425s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-8435b080-1da3-4f08-ad2e-a0d060e95de7" released by "_delete_snapshot" :: held 2.174s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.327s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.736s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1236189827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe39420b-8a35-4d64-912f-b742bd1d42ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f66bf9259c4f1ca1ae455ecded6c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:24Z,use_quota=True,user_id='e50db9f51e1d4d88a194ae765f631ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Creating volume fe39420b-8a35-4d64-912f-b742bd1d42ea {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:53:43 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da749b1-99ce-4a03-8326-62f4bee12b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60', 'volume_size': 1, 'source_volid': 'd41a7c2d-6854-40bc-876c-75651fdbbfd1', 'source_volstatus': 'available'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:43 devstack sudo[89024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea 1073741824
Apr 16 19:53:43 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eec4dc3-8d43-45c5-b3c7-38fc61730aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:43 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Volume volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60 (b1fe3a17-6403-44aa-8a58-4fd568dd6d60): created successfully
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eec4dc3-8d43-45c5-b3c7-38fc61730aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (6bc23c79-0879-4065-b3ce-f947370ce60f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:43 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a5fd8e91-d8ba-42ab-83ad-e510d782e371 tempest-VolumesGetTest-2085363863 None] Created volume successfully.
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:43 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (ef93d9e8-cc83-4f68-a4b2-ec03ea3b483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc65b89-7d79-4a28-8c03-ac3310c8720c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea 1073741824" returned: 0 in 0.620s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc65b89-7d79-4a28-8c03-ac3310c8720c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1004255175',display_name='tempest-VolumesGetTest-Volume-1320362445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ebdb71-3166-4863-b3fe-631b94fffb4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c6361144b541e0aeb112b8d6e8fdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:44Z,use_quota=True,user_id='beb43ad1c4b04aa591d3928ad16096a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba2234d-6750-4fec-ba94-6f4b6712ee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba2234d-6750-4fec-ba94-6f4b6712ee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3aab741-446a-4416-8edb-0a40fe757ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3aab741-446a-4416-8edb-0a40fe757ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ebdb71-3166-4863-b3fe-631b94fffb4c', 'volume_name': 'volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f21b36-1e8b-4337-94f7-ece61980a987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f21b36-1e8b-4337-94f7-ece61980a987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53b5dc9-7418-403f-8296-0e6ce6dc4266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:43 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Volume c8ebdb71-3166-4863-b3fe-631b94fffb4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c', 'volume_size': 1}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:43 devstack sudo[89029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea
Apr 16 19:53:43 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:44 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea" returned: 0 in 0.417s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-727293870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07e0322-b4ca-4436-b062-b1bbfdf64a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78f8e51866f4471970271bbb6a649d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:40Z,use_quota=True,user_id='c90a6582aa9d4f32bc8903193fe97cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Creating volume d07e0322-b4ca-4436-b062-b1bbfdf64a99 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:53:44 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17490991-9b3e-4954-9594-29c860e1616d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe39420b-8a35-4d64-912f-b742bd1d42ea', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7df8ec-13e9-44c1-94de-973a2d80a697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:44 devstack sudo[89032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 1073741824
Apr 16 19:53:44 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:44 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Volume volume-fe39420b-8a35-4d64-912f-b742bd1d42ea (fe39420b-8a35-4d64-912f-b742bd1d42ea): created successfully
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7df8ec-13e9-44c1-94de-973a2d80a697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Flow 'volume_create_manager' (042fa2e6-4aae-4721-93d2-58da12a4f703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:44 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-774c7cad-3ccd-469a-b856-de0ab53c0c05 tempest-VolumesSnapshotTestJSON-1302484543 None] Created volume successfully.
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:44 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 1073741824" returned: 0 in 0.545s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:44 devstack sudo[89038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99
Apr 16 19:53:44 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:45 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99" returned: 0 in 0.415s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.468s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541be004-0a69-4a62-a785-ba608c74f4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ba9b73508740189fa604a5ebf5d4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:43Z,use_quota=True,user_id='bb5c8d54b2f8482cb600d88aee8cb68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Creating volume 541be004-0a69-4a62-a785-ba608c74f4a2 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:53:45 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-541be004-0a69-4a62-a785-ba608c74f4a2 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:45 devstack sudo[89041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-541be004-0a69-4a62-a785-ba608c74f4a2 1073741824
Apr 16 19:53:45 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG cinder.volume.volume_utils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Attempting download of ab1fba02-b27f-4200-aae8-7c2e7a56bc6e ((None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}])) to volume d07e0322-b4ca-4436-b062-b1bbfdf64a99. {{(pid=82616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[937204d3-f5a1-460e-aa42-df3a577d8643]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_dz95vlbx {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:45 devstack sudo[89043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_dz95vlbx
Apr 16 19:53:45 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:45 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-541be004-0a69-4a62-a785-ba608c74f4a2 1073741824" returned: 0 in 0.522s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-541be004-0a69-4a62-a785-ba608c74f4a2 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:45 devstack sudo[89050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-541be004-0a69-4a62-a785-ba608c74f4a2
Apr 16 19:53:45 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:45 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_dz95vlbx" returned: 0 in 0.521s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_dz95vlbx {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:45 devstack sudo[89052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_dz95vlbx
Apr 16 19:53:45 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:46 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-541be004-0a69-4a62-a785-ba608c74f4a2" returned: 0 in 0.400s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.383s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1004255175',display_name='tempest-VolumesGetTest-Volume-1320362445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ebdb71-3166-4863-b3fe-631b94fffb4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c6361144b541e0aeb112b8d6e8fdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:44Z,use_quota=True,user_id='beb43ad1c4b04aa591d3928ad16096a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Creating volume c8ebdb71-3166-4863-b3fe-631b94fffb4c {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:53:46 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225e6cf0-8fbd-4acb-b943-82cf4e6ff94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-541be004-0a69-4a62-a785-ba608c74f4a2', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d6cd47-5a21-4c58-a14c-4d4fb18b8b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:46 devstack sudo[89057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c 1073741824
Apr 16 19:53:46 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:46 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Volume volume-541be004-0a69-4a62-a785-ba608c74f4a2 (541be004-0a69-4a62-a785-ba608c74f4a2): created successfully
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d6cd47-5a21-4c58-a14c-4d4fb18b8b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Flow 'volume_create_manager' (4cbc4184-f670-4b20-af69-0bf6b117ca68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:46 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-09671624-e255-47be-9b5f-2d7c03a775da tempest-CinderUnicodeTest-997147286 None] Created volume successfully.
Apr 16 19:53:46 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_dz95vlbx" returned: 1 in 0.463s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_dz95vlbx' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d90b34-ac19-4ef7-bd87-80e3245e7b14]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:46 devstack sudo[89059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD
Apr 16 19:53:46 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:46 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c 1073741824" returned: 0 in 0.499s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:46 devstack sudo[89067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c
Apr 16 19:53:46 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:46 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] ab1fba02-b27f-4200-aae8-7c2e7a56bc6e was qcow2, converting to raw {{(pid=82616) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 16 19:53:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:46 devstack sudo[89069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99
Apr 16 19:53:46 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:47 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c" returned: 0 in 0.421s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.500s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53b5dc9-7418-403f-8296-0e6ce6dc4266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add2ad56-155a-4ef5-945b-3b3813893bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:47 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Volume volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c (c8ebdb71-3166-4863-b3fe-631b94fffb4c): created successfully
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add2ad56-155a-4ef5-945b-3b3813893bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (ef93d9e8-cc83-4f68-a4b2-ec03ea3b483b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] Creating offline snapshot fbb83e60-261b-444c-a03f-1fd6d9033fad of volume fe39420b-8a35-4d64-912f-b742bd1d42ea {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f96af7-2b19-484b-a071-30fdd6f2a086]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:47 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-fdf4c7d9-c052-4405-90ef-9119ab544088 tempest-VolumesGetTest-2085363863 None] Created volume successfully.
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Flow 'volume_create_manager' (763519d4-3566-4c74-a218-c500b58e9e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5af206-9277-4c6c-94c4-efce91e22700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5af206-9277-4c6c-94c4-efce91e22700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1753994288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1569be7d-3194-47d8-8007-dbad7f23df0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ba9b73508740189fa604a5ebf5d4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:47Z,use_quota=True,user_id='bb5c8d54b2f8482cb600d88aee8cb68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31af5bbf-eb40-4757-926d-fec3aadc725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31af5bbf-eb40-4757-926d-fec3aadc725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8324d4-8eef-4bcc-a995-76b14d3cd3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8324d4-8eef-4bcc-a995-76b14d3cd3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1569be7d-3194-47d8-8007-dbad7f23df0a', 'volume_name': 'volume-1569be7d-3194-47d8-8007-dbad7f23df0a', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd869dd-e23c-4d8b-a0dd-918ae3524ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd869dd-e23c-4d8b-a0dd-918ae3524ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da6a5ae-5863-4d68-bb4e-04c7a9ab2f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:47 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Volume 1569be7d-3194-47d8-8007-dbad7f23df0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1569be7d-3194-47d8-8007-dbad7f23df0a', 'volume_size': 1}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:47 devstack sudo[89088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea
Apr 16 19:53:47 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:47 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99" returned: 0 in 0.938s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_a4qo5ezmdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:53:47 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Converted 112.00 MB image at 112.00 MB/s
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:47 devstack sudo[89090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 1G
Apr 16 19:53:47 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:47 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea" returned: 0 in 0.624s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:47 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad 1G
Apr 16 19:53:47 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-c8ebdb71-3166-4863-b3fe-631b94fffb4c-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Lock "cinder-c8ebdb71-3166-4863-b3fe-631b94fffb4c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-quobyte-c8ebdb71-3166-4863-b3fe-631b94fffb4c" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-c8ebdb71-3166-4863-b3fe-631b94fffb4c" acquired by "delete_volume" :: waited 0.018s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa3304a-5446-4c08-b5a0-9db58b468196]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:48 devstack sudo[89098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c
Apr 16 19:53:48 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:48 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 1G" returned: 0 in 0.488s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[14507ce4-dc12-40b9-8de1-8acb6777674e]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:48 devstack sudo[89102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99
Apr 16 19:53:48 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:48 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad 1G" returned: 0 in 0.559s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe39420b-8a35-4d64-912f-b742bd1d42ea -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:48 devstack sudo[89107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe39420b-8a35-4d64-912f-b742bd1d42ea -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad
Apr 16 19:53:48 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:48 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c" returned: 0 in 0.515s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:48 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c
Apr 16 19:53:48 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:48 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99" returned: 0 in 0.499s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:48 devstack sudo[89116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99
Apr 16 19:53:48 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:48 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe39420b-8a35-4d64-912f-b742bd1d42ea -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad" returned: 0 in 0.477s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:48 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad is being set with open permissions: ugo+rw
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:48 devstack sudo[89121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad
Apr 16 19:53:48 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:48 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c8ebdb71-3166-4863-b3fe-631b94fffb4c" returned: 0 in 0.436s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-c8ebdb71-3166-4863-b3fe-631b94fffb4c" released by "delete_volume" :: held 0.974s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:48 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Created reservations ['776020b1-f307-4f19-8e68-b7b1382e895a', 'f3474991-f870-4c54-8c7d-d757f05e9d79', '21558667-35bc-4419-b0b5-504bd3c457cc', '1b46cde7-5d81-40a1-a185-e82d52b0d31d'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:49 devstack sudo[89125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:49 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-b1fe3a17-6403-44aa-8a58-4fd568dd6d60-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Lock "cinder-b1fe3a17-6403-44aa-8a58-4fd568dd6d60-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-quobyte-b1fe3a17-6403-44aa-8a58-4fd568dd6d60" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:49 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99" returned: 1 in 0.579s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.volume.volume_utils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Downloaded image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e ((None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}])) to volume d07e0322-b4ca-4436-b062-b1bbfdf64a99 successfully. {{(pid=82616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Temporary image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e for user c90a6582aa9d4f32bc8903193fe97cc9 is deleted. {{(pid=82616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.volume.volume_utils [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Marking volume d07e0322-b4ca-4436-b062-b1bbfdf64a99 as bootable. {{(pid=82616) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-b1fe3a17-6403-44aa-8a58-4fd568dd6d60" acquired by "delete_volume" :: waited 0.034s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Copying metadata from image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e to d07e0322-b4ca-4436-b062-b1bbfdf64a99. {{(pid=82616) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Creating volume glance metadata for volume d07e0322-b4ca-4436-b062-b1bbfdf64a99 backed by image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82616) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[838b4854-c7b5-4224-84c9-a18c399e82cf]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:49 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad" returned: 0 in 0.455s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:49 devstack sudo[89131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.info
Apr 16 19:53:49 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:49 devstack sudo[89130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60
Apr 16 19:53:49 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72772be2-3c21-4f5b-90f4-58efbeb6f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99', 'volume_size': 1, 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94595a210065472391c483fcf54511ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'created_at': datetime.datetime(2026, 4, 16, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa3631dd150>}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84e608b-55a8-49d1-91fa-b4f51e0fce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:49 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Volume volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 (d07e0322-b4ca-4436-b062-b1bbfdf64a99): created successfully
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84e608b-55a8-49d1-91fa-b4f51e0fce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Flow 'volume_create_manager' (01f1ae5f-e317-45d2-af0f-d678aee3e75d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:49 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c707e59c-231c-4e95-85dc-dfdae6154a9b tempest-VolumesImageMetadata-1576190642 None] Created volume successfully.
Apr 16 19:53:49 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.483s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:49 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Deleted volume successfully.
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-43364eca-40cd-4a11-a98b-23f2cf683b6d tempest-VolumesGetTest-2085363863 None] Lock "cinder-c8ebdb71-3166-4863-b3fe-631b94fffb4c-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:49 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.info" returned: 0 in 0.429s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:49 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.info is being set with open permissions: ugo+rw
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:49 devstack sudo[89139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.info
Apr 16 19:53:49 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:49 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60" returned: 0 in 0.510s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:49 devstack sudo[89141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60
Apr 16 19:53:49 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Acquiring lock "cinder-d07e0322-b4ca-4436-b062-b1bbfdf64a99-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Lock "cinder-d07e0322-b4ca-4436-b062-b1bbfdf64a99-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Acquiring lock "cinder-quobyte-d07e0322-b4ca-4436-b062-b1bbfdf64a99" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Lock "cinder-quobyte-d07e0322-b4ca-4436-b062-b1bbfdf64a99" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[717de354-a55d-4b41-96db-9dfc9e805f78]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:50 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.info" returned: 0 in 0.439s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.091s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.933s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1753994288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1569be7d-3194-47d8-8007-dbad7f23df0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ba9b73508740189fa604a5ebf5d4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:47Z,use_quota=True,user_id='bb5c8d54b2f8482cb600d88aee8cb68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Creating volume 1569be7d-3194-47d8-8007-dbad7f23df0a {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:53:50 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:50 devstack sudo[89144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99
Apr 16 19:53:50 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:50 devstack sudo[89147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a 1073741824
Apr 16 19:53:50 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:50 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-b3746e73-d617-48e4-afb3-e0668ae5dc9f tempest-VolumesSnapshotTestJSON-1302484543 None] Create snapshot completed successfully
Apr 16 19:53:50 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b1fe3a17-6403-44aa-8a58-4fd568dd6d60" returned: 0 in 0.474s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-b1fe3a17-6403-44aa-8a58-4fd568dd6d60" released by "delete_volume" :: held 1.008s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Created reservations ['311545fa-4b76-4020-bbb8-d29c48cf7b95', 'e72d7b07-a64b-4455-bc47-fc8bf23bdbe7', '4ac15fbf-e287-4c8c-80e4-b68c898f8c2a', '59fe0ba0-25f3-4c05-9b9e-fecc13a505d9'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:50 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:50 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:50 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99" returned: 0 in 0.556s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:50 devstack sudo[89156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99
Apr 16 19:53:50 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:50 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a 1073741824" returned: 0 in 0.585s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:50 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.465s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:50 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Deleted volume successfully.
Apr 16 19:53:50 devstack sudo[89159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a
Apr 16 19:53:50 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a8d20067-01a4-4971-bdeb-ab190a38cfa9 tempest-VolumesGetTest-2085363863 None] Lock "cinder-b1fe3a17-6403-44aa-8a58-4fd568dd6d60-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Flow 'volume_create_manager' (c3a56d26-5169-487e-83e2-c7dd3b916473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc7fc9f-0a9f-46b3-ab19-74f008230391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc7fc9f-0a9f-46b3-ab19-74f008230391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-415718815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91257a46-9684-4831-80db-21fe91675afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f66bf9259c4f1ca1ae455ecded6c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=fbb83e60-261b-444c-a03f-1fd6d9033fad,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:51Z,use_quota=True,user_id='e50db9f51e1d4d88a194ae765f631ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd32989-4011-4900-813c-00ff32780be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd32989-4011-4900-813c-00ff32780be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5f8c6f-a527-4b36-a0ec-f7823b438314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:51 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5f8c6f-a527-4b36-a0ec-f7823b438314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '91257a46-9684-4831-80db-21fe91675afa', 'volume_name': 'volume-91257a46-9684-4831-80db-21fe91675afa', 'volume_size': 2, 'snapshot_id': 'fbb83e60-261b-444c-a03f-1fd6d9033fad'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e402d34f-71d3-466f-9a3d-6e5f8ca01df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e402d34f-71d3-466f-9a3d-6e5f8ca01df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45632fc-038b-4918-aac7-6b673c310bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:51 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Volume 91257a46-9684-4831-80db-21fe91675afa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-91257a46-9684-4831-80db-21fe91675afa', 'volume_size': 2, 'snapshot_id': 'fbb83e60-261b-444c-a03f-1fd6d9033fad'}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99" returned: 1 in 0.535s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:51 devstack sudo[89165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99
Apr 16 19:53:51 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:51 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a" returned: 0 in 0.467s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.053s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-fbb83e60-261b-444c-a03f-1fd6d9033fad-91257a46-9684-4831-80db-21fe91675afa" by "_create_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-fbb83e60-261b-444c-a03f-1fd6d9033fad-91257a46-9684-4831-80db-21fe91675afa" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Creating volume 91257a46-9684-4831-80db-21fe91675afa from snapshot fbb83e60-261b-444c-a03f-1fd6d9033fad {{(pid=82616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-91257a46-9684-4831-80db-21fe91675afa" by "_copy_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da6a5ae-5863-4d68-bb4e-04c7a9ab2f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1569be7d-3194-47d8-8007-dbad7f23df0a', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc12c5dc-cb36-4b14-8475-a19e3f30cb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:51 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Volume volume-1569be7d-3194-47d8-8007-dbad7f23df0a (1569be7d-3194-47d8-8007-dbad7f23df0a): created successfully
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc12c5dc-cb36-4b14-8475-a19e3f30cb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Flow 'volume_create_manager' (763519d4-3566-4c74-a218-c500b58e9e3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-91257a46-9684-4831-80db-21fe91675afa" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] snapshot: fbb83e60-261b-444c-a03f-1fd6d9033fad, volume: 91257a46-9684-4831-80db-21fe91675afa,  {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 19:53:51 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-d1979d60-e9e8-4f1e-83f4-da5ce4f0dd14 tempest-CinderUnicodeTest-997147286 None] Created volume successfully.
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc66c99-832a-453c-9e21-bbb5ac4828c1]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:51 devstack sudo[89167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad
Apr 16 19:53:51 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-d41a7c2d-6854-40bc-876c-75651fdbbfd1-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:51 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d07e0322-b4ca-4436-b062-b1bbfdf64a99" returned: 0 in 0.450s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Lock "cinder-d41a7c2d-6854-40bc-876c-75651fdbbfd1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Lock "cinder-quobyte-d07e0322-b4ca-4436-b062-b1bbfdf64a99" released by "delete_volume" :: held 1.600s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-quobyte-d41a7c2d-6854-40bc-876c-75651fdbbfd1" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-d41a7c2d-6854-40bc-876c-75651fdbbfd1" acquired by "delete_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfeb3d3-d644-4ca3-8933-3f20bae47b93]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Created reservations ['f1034616-b84b-45b3-83c0-9f21ab5d26b4', 'dafc8c27-8656-48c7-bbd3-b28beeda20cb', '66c4f3e6-c600-4050-8e71-c400ff0c100b', '4337948d-d1cb-4046-bc9f-fd66270a3cab'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:51 devstack sudo[89170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1
Apr 16 19:53:51 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:51 devstack sudo[89171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:51 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:51 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad" returned: 0 in 0.558s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe39420b-8a35-4d64-912f-b742bd1d42ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Creating direct copy from snapshot {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99fdbc9-c40d-4266-84da-98ec53dd6e85]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:51 devstack sudo[89177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea
Apr 16 19:53:52 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:52 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1" returned: 0 in 0.501s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:52 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.460s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:52 devstack sudo[89183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1
Apr 16 19:53:52 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:52 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Deleted volume successfully.
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-24b5b1d7-f347-496a-8652-73291a7f8742 tempest-VolumesImageMetadata-1576190642 None] Lock "cinder-d07e0322-b4ca-4436-b062-b1bbfdf64a99-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:52 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea" returned: 0 in 0.537s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG cinder.utils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Path /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa not found in is_blk_device check {{(pid=82616) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:52 devstack sudo[89188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa
Apr 16 19:53:52 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:52 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d41a7c2d-6854-40bc-876c-75651fdbbfd1" returned: 0 in 0.483s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-d41a7c2d-6854-40bc-876c-75651fdbbfd1" released by "delete_volume" :: held 1.021s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Created reservations ['95b73410-a130-40fd-a658-a36a6dbac233', '7679643d-57bf-4489-9da8-994a169c8cea', 'c38f2869-74b7-45ac-8a3e-b9d5eb7383dc', '82397cc5-a6e5-4051-a872-47ca5fdb7b04'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:52 devstack sudo[89191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:52 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:53 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 1.225s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:53 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:54 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Deleted volume successfully.
Apr 16 19:53:54 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-69a60670-7bf5-4580-9807-64b4db8a6dbc tempest-VolumesGetTest-2085363863 None] Lock "cinder-d41a7c2d-6854-40bc-876c-75651fdbbfd1-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:54 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (e3715c25-a315-4f3f-9581-9659f4e769e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9324ce-a94a-48d1-9e36-091d7d9657b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9324ce-a94a-48d1-9e36-091d7d9657b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-516449367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01541198-ff1e-47c9-bc2d-6367cc491f49,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='18c6361144b541e0aeb112b8d6e8fdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:55Z,use_quota=True,user_id='beb43ad1c4b04aa591d3928ad16096a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a6abc4-be04-4528-9701-edd55655d23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a6abc4-be04-4528-9701-edd55655d23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9dd76ac-bf3a-4e81-a808-4cbf47d76a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:54 devstack cinder-volume[82616]: DEBUG cinder.image.glance [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Creating Keystone auth plugin from conf {{(pid=82616) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 16 19:53:54 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa" returned: 0 in 2.521s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:54 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e276414-c9c2-4d6d-b6cf-6ceb88ce773b]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:55 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea
Apr 16 19:53:55 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9dd76ac-bf3a-4e81-a808-4cbf47d76a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01541198-ff1e-47c9-bc2d-6367cc491f49', 'volume_name': 'volume-01541198-ff1e-47c9-bc2d-6367cc491f49', 'volume_size': 1, 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94595a210065472391c483fcf54511ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'created_at': datetime.datetime(2026, 4, 16, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa358635ab0>}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170b6d13-e3ec-4324-83e7-c0cc1e551f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170b6d13-e3ec-4324-83e7-c0cc1e551f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cd5232-b7c8-4d04-b53c-fbca9862ae78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:55 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Volume 01541198-ff1e-47c9-bc2d-6367cc491f49: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01541198-ff1e-47c9-bc2d-6367cc491f49', 'volume_size': 1, 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94595a210065472391c483fcf54511ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'created_at': datetime.datetime(2026, 4, 16, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa358635ab0>}
Apr 16 19:53:55 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Trying to clone 01541198-ff1e-47c9-bc2d-6367cc491f49 from image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]). {{(pid=82616) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 16 19:53:55 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82616) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 16 19:53:55 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Image download 20.69 MB at 20.69 MB/s
Apr 16 19:53:55 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f76e8e-aa41-4751-8c55-c30db7dafca9]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:55 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD
Apr 16 19:53:55 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:55 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea" returned: 0 in 0.703s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:55 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea, size 1024.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:53:55 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Converted 1024.00 MB image at 405.95 MB/s
Apr 16 19:53:55 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa is being set with open permissions: ugo+rw
Apr 16 19:53:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:55 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa
Apr 16 19:53:55 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:56 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Temporary image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e is fetched for user beb43ad1c4b04aa591d3928ad16096a9. {{(pid=82616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a17364d-d00b-4af9-ada4-a3389b808e46]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:53:56 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Flow 'volume_create_manager' (ce53a0fb-f54f-45b1-9e1a-a7026126d8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0623281-6fba-4e2b-8842-df5b8bb791af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa" returned: 0 in 0.489s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-91257a46-9684-4831-80db-21fe91675afa" released by "_copy_volume_from_snapshot" :: held 4.897s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-fbb83e60-261b-444c-a03f-1fd6d9033fad-91257a46-9684-4831-80db-21fe91675afa" released by "_create_volume_from_snapshot" :: held 4.947s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.961s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:56 devstack sudo[89219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD
Apr 16 19:53:56 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0623281-6fba-4e2b-8842-df5b8bb791af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-216930163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36005b0e-7cc7-4316-995b-e3fb70032089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fac4ba9f6414d27b3d435e291a34c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:56Z,use_quota=True,user_id='e6ba285194fd4defa43c703e897ff97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12c7731-596d-4e61-a8d6-26bc4ed19bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12c7731-596d-4e61-a8d6-26bc4ed19bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e525554e-ba82-4876-80cb-7fc5b5f8d686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e525554e-ba82-4876-80cb-7fc5b5f8d686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36005b0e-7cc7-4316-995b-e3fb70032089', 'volume_name': 'volume-36005b0e-7cc7-4316-995b-e3fb70032089', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb3ad1a-5aa4-4143-a0be-60f6509b0b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb3ad1a-5aa4-4143-a0be-60f6509b0b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4baf64-f689-4d87-80ec-b83c830f8c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:56 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Volume 36005b0e-7cc7-4316-995b-e3fb70032089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36005b0e-7cc7-4316-995b-e3fb70032089', 'volume_size': 1}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-216930163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36005b0e-7cc7-4316-995b-e3fb70032089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fac4ba9f6414d27b3d435e291a34c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:56Z,use_quota=True,user_id='e6ba285194fd4defa43c703e897ff97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Creating volume 36005b0e-7cc7-4316-995b-e3fb70032089 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:53:56 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-36005b0e-7cc7-4316-995b-e3fb70032089 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:56 devstack sudo[89221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-36005b0e-7cc7-4316-995b-e3fb70032089 1073741824
Apr 16 19:53:56 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45632fc-038b-4918-aac7-6b673c310bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91257a46-9684-4831-80db-21fe91675afa', 'volume_size': 2, 'snapshot_id': 'fbb83e60-261b-444c-a03f-1fd6d9033fad'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736bbff5-b40c-40dd-9b99-0526b9b4ebc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:56 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Volume volume-91257a46-9684-4831-80db-21fe91675afa (91257a46-9684-4831-80db-21fe91675afa): created successfully
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736bbff5-b40c-40dd-9b99-0526b9b4ebc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Flow 'volume_create_manager' (c3a56d26-5169-487e-83e2-c7dd3b916473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:56 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-b5bd4b3b-cc05-4a4e-ac6e-73d79b36494d tempest-VolumesSnapshotTestJSON-1302484543 None] Created volume successfully.
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-91257a46-9684-4831-80db-21fe91675afa-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-91257a46-9684-4831-80db-21fe91675afa-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-91257a46-9684-4831-80db-21fe91675afa" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-91257a46-9684-4831-80db-21fe91675afa" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c25ca1c-0633-40e1-ac44-caa5638acdab]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:56 devstack sudo[89223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa
Apr 16 19:53:56 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:56 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:56 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-36005b0e-7cc7-4316-995b-e3fb70032089 1073741824" returned: 0 in 0.529s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-36005b0e-7cc7-4316-995b-e3fb70032089 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:56 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-36005b0e-7cc7-4316-995b-e3fb70032089
Apr 16 19:53:56 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:57 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa" returned: 0 in 0.507s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:57 devstack sudo[89236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa
Apr 16 19:53:57 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:57 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-36005b0e-7cc7-4316-995b-e3fb70032089" returned: 0 in 0.446s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.650s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] Creating offline snapshot a1a20052-d6ff-45e8-a5b5-53232a469d6f of volume 1569be7d-3194-47d8-8007-dbad7f23df0a {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4baf64-f689-4d87-80ec-b83c830f8c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36005b0e-7cc7-4316-995b-e3fb70032089', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050ae4f4-900c-4d81-95a7-c409cf270fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[59159ba5-46ff-4f85-8a8e-9ff72e6b1236]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:57 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Volume volume-36005b0e-7cc7-4316-995b-e3fb70032089 (36005b0e-7cc7-4316-995b-e3fb70032089): created successfully
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050ae4f4-900c-4d81-95a7-c409cf270fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Flow 'volume_create_manager' (ce53a0fb-f54f-45b1-9e1a-a7026126d8e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:53:57 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-3562de80-d2c0-4a1e-a4c3-701c763cea14 tempest-VolumesTransfersV355Test-408731170 None] Created volume successfully.
Apr 16 19:53:57 devstack sudo[89239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a
Apr 16 19:53:57 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:57 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-91257a46-9684-4831-80db-21fe91675afa" returned: 0 in 0.410s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-91257a46-9684-4831-80db-21fe91675afa" released by "delete_volume" :: held 0.947s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Created reservations ['2315cc60-a8fc-4bca-8ed1-892923be857e', '97e609e5-9d17-4c09-9f1c-8a613ae41dae', 'ad6b8a61-c78f-45d3-93b2-69f3fa53df39', '6be9e91f-f50b-4867-b12b-d93ccdd18cda'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:57 devstack sudo[89242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:53:57 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-fbb83e60-261b-444c-a03f-1fd6d9033fad-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-fbb83e60-261b-444c-a03f-1fd6d9033fad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-fe39420b-8a35-4d64-912f-b742bd1d42ea" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-fe39420b-8a35-4d64-912f-b742bd1d42ea" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-fbb83e60-261b-444c-a03f-1fd6d9033fad" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-fbb83e60-261b-444c-a03f-1fd6d9033fad" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Deleting offline snapshot fbb83e60-261b-444c-a03f-1fd6d9033fad of volume fe39420b-8a35-4d64-912f-b742bd1d42ea {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] snapshot_file for this snap is: volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c42b929-663e-41e9-8943-9287ad962da0]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:57 devstack sudo[89244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad
Apr 16 19:53:57 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:57 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a" returned: 0 in 0.525s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:57 devstack sudo[89249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f 1G
Apr 16 19:53:57 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:58 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.487s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:58 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:53:58 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Deleted volume successfully.
Apr 16 19:53:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-dd5f1ab1-0bfd-4f7d-9e7d-94e2857588b5 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-91257a46-9684-4831-80db-21fe91675afa-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:58 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad" returned: 0 in 0.507s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe39420b-8a35-4d64-912f-b742bd1d42ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:53:58 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4b7267-4b2d-4ce7-a345-8901eb3b15f5]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:58 devstack sudo[89258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea
Apr 16 19:53:58 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:58 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f 1G" returned: 0 in 0.569s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1569be7d-3194-47d8-8007-dbad7f23df0a -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:58 devstack sudo[89260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1569be7d-3194-47d8-8007-dbad7f23df0a -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f
Apr 16 19:53:58 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:58 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-347e4bcd-f3f2-4ec0-9377-1e078cca8eb4 tempest-VolumesTransfersV355Test-26802475 None] Transfer volume completed successfully.
Apr 16 19:53:58 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea" returned: 0 in 0.511s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:58 devstack sudo[89265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad
Apr 16 19:53:58 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:58 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1569be7d-3194-47d8-8007-dbad7f23df0a -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f" returned: 0 in 0.437s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:58 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f is being set with open permissions: ugo+rw
Apr 16 19:53:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:58 devstack sudo[89270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f
Apr 16 19:53:58 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:59 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad" returned: 0 in 0.522s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:59 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f" returned: 0 in 0.421s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:59 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad
Apr 16 19:53:59 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:59 devstack sudo[89278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.info
Apr 16 19:53:59 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Acquiring lock "cinder-36005b0e-7cc7-4316-995b-e3fb70032089-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Lock "cinder-36005b0e-7cc7-4316-995b-e3fb70032089-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Acquiring lock "cinder-quobyte-36005b0e-7cc7-4316-995b-e3fb70032089" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Lock "cinder-quobyte-36005b0e-7cc7-4316-995b-e3fb70032089" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[83833413-1da1-4ccc-b846-fbcdfe0617e6]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-36005b0e-7cc7-4316-995b-e3fb70032089 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:59 devstack sudo[89280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-36005b0e-7cc7-4316-995b-e3fb70032089
Apr 16 19:53:59 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:59 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea.fbb83e60-261b-444c-a03f-1fd6d9033fad" returned: 0 in 0.474s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-fbb83e60-261b-444c-a03f-1fd6d9033fad" released by "_delete_snapshot" :: held 2.069s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-fe39420b-8a35-4d64-912f-b742bd1d42ea" released by "delete_snapshot" :: held 2.083s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:53:59 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.info" returned: 0 in 0.493s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:53:59 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.info is being set with open permissions: ugo+rw
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:53:59 devstack sudo[89284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.info
Apr 16 19:53:59 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Created reservations ['49f3adff-1a70-41a5-8bcf-2830676e082e', '3e5e1e36-b0b7-4613-839e-ee7d9ef963fc', '71b56c63-59e7-46b8-bc56-8526153e9b20', 'f772a152-81a5-4965-b4fb-b9b5ac6b6c30'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:53:59 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Delete snapshot completed successfully.
Apr 16 19:53:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-cd92eaa6-2c05-4198-8943-4be3ffdc98b8 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-fbb83e60-261b-444c-a03f-1fd6d9033fad-delete_snapshot" released by "delete_snapshot" :: held 2.183s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:00 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-36005b0e-7cc7-4316-995b-e3fb70032089" returned: 0 in 0.507s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-36005b0e-7cc7-4316-995b-e3fb70032089 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:00 devstack sudo[89289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-36005b0e-7cc7-4316-995b-e3fb70032089
Apr 16 19:54:00 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:00 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.info" returned: 0 in 0.416s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.930s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.513s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-516449367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01541198-ff1e-47c9-bc2d-6367cc491f49,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='18c6361144b541e0aeb112b8d6e8fdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:53:55Z,use_quota=True,user_id='beb43ad1c4b04aa591d3928ad16096a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Creating volume 01541198-ff1e-47c9-bc2d-6367cc491f49 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:54:00 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:00 devstack sudo[89292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 1073741824
Apr 16 19:54:00 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:00 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0b4b98b6-c912-4ebb-a042-859c150828db tempest-CinderUnicodeTest-997147286 None] Create snapshot completed successfully
Apr 16 19:54:00 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-36005b0e-7cc7-4316-995b-e3fb70032089" returned: 0 in 0.424s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Lock "cinder-quobyte-36005b0e-7cc7-4316-995b-e3fb70032089" released by "delete_volume" :: held 0.952s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Created reservations ['f1c01b38-377d-4cd0-9187-7e871b1177c3', '1388e78d-1833-408f-98a9-c8d9f2516353', '968bc60d-c0c2-45d6-9358-d2211bc3b70e', '8fbb4ab0-8a63-4bb7-baf2-f2f05562b7b5'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:00 devstack sudo[89295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:00 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:00 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 1073741824" returned: 0 in 0.547s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:00 devstack sudo[89300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49
Apr 16 19:54:00 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-fe39420b-8a35-4d64-912f-b742bd1d42ea-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-fe39420b-8a35-4d64-912f-b742bd1d42ea-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-fe39420b-8a35-4d64-912f-b742bd1d42ea" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-fe39420b-8a35-4d64-912f-b742bd1d42ea" acquired by "delete_volume" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d5fd3a-bced-44d1-ac96-fd05e3161533]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:00 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:54:01 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Flow 'volume_create_manager' (5ea7a28c-22df-4efd-b3fb-bd8fe5e44b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0831bd-f00c-4658-abf6-824f323fa545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:01 devstack sudo[89303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea
Apr 16 19:54:01 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Acquiring lock "cinder-a1a20052-d6ff-45e8-a5b5-53232a469d6f-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.518s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0831bd-f00c-4658-abf6-824f323fa545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1355308477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fac4ba9f6414d27b3d435e291a34c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:01Z,use_quota=True,user_id='e6ba285194fd4defa43c703e897ff97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4592f451-32d3-415f-93fa-3c742c6ffcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4592f451-32d3-415f-93fa-3c742c6ffcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb032e0-f99d-4da2-b7b0-ac33fc8cffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb032e0-f99d-4da2-b7b0-ac33fc8cffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2', 'volume_name': 'volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3c896e-7fd6-46ae-af03-34108b48a538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3c896e-7fd6-46ae-af03-34108b48a538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c631e65c-7a5d-485d-a4c2-fc1b8749ba2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:01 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Volume ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2', 'volume_size': 1}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:01 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Deleted volume successfully.
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-29900dc8-0959-4cb3-8895-1bc31fce23d6 tempest-VolumesTransfersV355Test-952128677 None] Lock "cinder-36005b0e-7cc7-4316-995b-e3fb70032089-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Lock "cinder-a1a20052-d6ff-45e8-a5b5-53232a469d6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Acquiring lock "cinder-quobyte-1569be7d-3194-47d8-8007-dbad7f23df0a" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Lock "cinder-quobyte-1569be7d-3194-47d8-8007-dbad7f23df0a" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Acquiring lock "cinder-quobyte-a1a20052-d6ff-45e8-a5b5-53232a469d6f" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Lock "cinder-quobyte-a1a20052-d6ff-45e8-a5b5-53232a469d6f" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Deleting offline snapshot a1a20052-d6ff-45e8-a5b5-53232a469d6f of volume 1569be7d-3194-47d8-8007-dbad7f23df0a {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] snapshot_file for this snap is: volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0e2575-58fc-4d2e-8e1e-6e991797c244]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:01 devstack sudo[89305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f
Apr 16 19:54:01 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:01 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49" returned: 0 in 0.530s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.242s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1355308477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fac4ba9f6414d27b3d435e291a34c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:01Z,use_quota=True,user_id='e6ba285194fd4defa43c703e897ff97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Creating volume ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:54:01 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.volume_utils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Attempting download of ab1fba02-b27f-4200-aae8-7c2e7a56bc6e ((None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}])) to volume 01541198-ff1e-47c9-bc2d-6367cc491f49. {{(pid=82616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 16 19:54:01 devstack sudo[89308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2 1073741824
Apr 16 19:54:01 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1d21a6-162e-4634-ad47-18107497a9ee]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_by53i98i {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:01 devstack sudo[89311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_by53i98i
Apr 16 19:54:01 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:01 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea" returned: 0 in 0.523s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:01 devstack sudo[89315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea
Apr 16 19:54:01 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:01 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f" returned: 0 in 0.539s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1569be7d-3194-47d8-8007-dbad7f23df0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[45824ea6-4231-41c7-a426-e7d0312fefe7]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:01 devstack sudo[89322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a
Apr 16 19:54:01 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:01 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2 1073741824" returned: 0 in 0.511s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:01 devstack sudo[89328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2
Apr 16 19:54:01 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:01 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_by53i98i" returned: 0 in 0.516s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_by53i98i {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:01 devstack sudo[89330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_by53i98i
Apr 16 19:54:01 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:01 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fe39420b-8a35-4d64-912f-b742bd1d42ea" returned: 0 in 0.502s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-fe39420b-8a35-4d64-912f-b742bd1d42ea" released by "delete_volume" :: held 1.088s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Created reservations ['27dca97e-4289-4664-aafc-2a0f14465554', '530807cd-5daa-4ff7-90ae-b5abb7df91a3', '87ef4ad2-bf38-4b6b-8564-e0b4346e6598', 'af376700-c37b-452f-bed5-122570add4f5'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:02 devstack sudo[89332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:02 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:02 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a" returned: 0 in 0.606s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:02 devstack sudo[89338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f
Apr 16 19:54:02 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:02 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2" returned: 0 in 0.496s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c631e65c-7a5d-485d-a4c2-fc1b8749ba2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a762bdbc-377a-4540-b461-04f721847ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:02 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Volume volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2 (ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2): created successfully
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a762bdbc-377a-4540-b461-04f721847ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Flow 'volume_create_manager' (5ea7a28c-22df-4efd-b3fb-bd8fe5e44b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:02 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a17b0124-045d-4be3-b8d8-f84e67af2841 tempest-VolumesTransfersV355Test-408731170 None] Created volume successfully.
Apr 16 19:54:02 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_by53i98i" returned: 1 in 0.506s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_by53i98i' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[737f4422-db36-4ebd-8888-7eca1862e702]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:02 devstack sudo[89342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD
Apr 16 19:54:02 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:02 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.443s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:02 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Deleted volume successfully.
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-75d714ee-989e-422b-85b7-5937379716e3 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-fe39420b-8a35-4d64-912f-b742bd1d42ea-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:02 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f" returned: 0 in 0.474s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:02 devstack sudo[89348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f
Apr 16 19:54:02 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:02 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD" returned: 0 in 0.512s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] ab1fba02-b27f-4200-aae8-7c2e7a56bc6e was qcow2, converting to raw {{(pid=82616) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 16 19:54:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:02 devstack sudo[89353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49
Apr 16 19:54:02 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:03 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a.a1a20052-d6ff-45e8-a5b5-53232a469d6f" returned: 0 in 0.427s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Lock "cinder-quobyte-a1a20052-d6ff-45e8-a5b5-53232a469d6f" released by "_delete_snapshot" :: held 2.110s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Lock "cinder-quobyte-1569be7d-3194-47d8-8007-dbad7f23df0a" released by "delete_snapshot" :: held 2.124s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Created reservations ['a0492c5e-0698-4cbb-939c-73ac039c766c', '173f6de5-840d-4c59-a695-afd3599d1d61', '4ee31984-028a-4803-8bb5-269868d9143d', '4c67fa8c-f79b-48a8-9dca-fe1d89608b8c'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Acquiring lock "cinder-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Flow 'volume_create_manager' (65fcd2a8-fb8d-4c0d-974a-a740a72baeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99542fa4-668f-4476-98e1-89211153d1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Lock "cinder-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99542fa4-668f-4476-98e1-89211153d1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-697540474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d836b72-b511-4f87-b017-37ab3d792f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f66bf9259c4f1ca1ae455ecded6c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:03Z,use_quota=True,user_id='e50db9f51e1d4d88a194ae765f631ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088af5ce-0bd4-4c2a-9394-c83ee65f2fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088af5ce-0bd4-4c2a-9394-c83ee65f2fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f427952-d4db-4f04-b59d-75c10b0102eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f427952-d4db-4f04-b59d-75c10b0102eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d836b72-b511-4f87-b017-37ab3d792f68', 'volume_name': 'volume-9d836b72-b511-4f87-b017-37ab3d792f68', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9f1302-8af1-4735-96bb-3564e864e23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9f1302-8af1-4735-96bb-3564e864e23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68aa7444-ee30-4de5-9548-d6827c586c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:03 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Volume 9d836b72-b511-4f87-b017-37ab3d792f68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d836b72-b511-4f87-b017-37ab3d792f68', 'volume_size': 1}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-697540474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d836b72-b511-4f87-b017-37ab3d792f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f66bf9259c4f1ca1ae455ecded6c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:03Z,use_quota=True,user_id='e50db9f51e1d4d88a194ae765f631ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Creating volume 9d836b72-b511-4f87-b017-37ab3d792f68 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:54:03 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:03 devstack sudo[89380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 1073741824
Apr 16 19:54:03 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:03 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Delete snapshot completed successfully.
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d406f427-d4e9-4821-9152-1af75b850e78 tempest-CinderUnicodeTest-997147286 None] Lock "cinder-a1a20052-d6ff-45e8-a5b5-53232a469d6f-delete_snapshot" released by "delete_snapshot" :: held 2.477s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Acquiring lock "cinder-quobyte-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Lock "cinder-quobyte-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[82932876-15b3-4fae-8965-50fd27cda143]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:03 devstack sudo[89402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2
Apr 16 19:54:03 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:04 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49" returned: 0 in 1.125s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_nkqfqo6wdevstack@QuobyteHD, size 112.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:54:04 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Converted 112.00 MB image at 99.40 MB/s
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:04 devstack sudo[89409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 1G
Apr 16 19:54:04 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:04 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 1073741824" returned: 0 in 0.583s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:04 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68
Apr 16 19:54:04 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Acquiring lock "cinder-1569be7d-3194-47d8-8007-dbad7f23df0a-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Lock "cinder-1569be7d-3194-47d8-8007-dbad7f23df0a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:04 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2" returned: 0 in 0.612s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:04 devstack sudo[89416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2
Apr 16 19:54:04 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Acquiring lock "cinder-quobyte-1569be7d-3194-47d8-8007-dbad7f23df0a" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Lock "cinder-quobyte-1569be7d-3194-47d8-8007-dbad7f23df0a" acquired by "delete_volume" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a98d59-9052-48ce-8237-3795be1bf280]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:04 devstack sudo[89418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a
Apr 16 19:54:04 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:04 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 1G" returned: 0 in 0.541s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c358db57-abdf-42fb-9f51-04cd69a70ee1]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:04 devstack sudo[89423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49
Apr 16 19:54:04 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:04 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68" returned: 0 in 0.591s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68aa7444-ee30-4de5-9548-d6827c586c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d836b72-b511-4f87-b017-37ab3d792f68', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:04 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe37dec-d03a-44c9-ae02-f496ff64ef1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2" returned: 0 in 0.519s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:04 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Volume volume-9d836b72-b511-4f87-b017-37ab3d792f68 (9d836b72-b511-4f87-b017-37ab3d792f68): created successfully
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe37dec-d03a-44c9-ae02-f496ff64ef1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Flow 'volume_create_manager' (65fcd2a8-fb8d-4c0d-974a-a740a72baeef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Lock "cinder-quobyte-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2" released by "delete_volume" :: held 1.183s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:04 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ea8f15a3-3f2a-4f9c-92e8-7d4378a0e15a tempest-VolumesSnapshotTestJSON-1302484543 None] Created volume successfully.
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Created reservations ['820f5e5b-ffbc-49f3-9491-9feffb7e22ee', '715c8813-6d52-4618-bfa6-e84370c4e436', '48f197e3-24a1-4f15-ada9-4c67fd9a4167', 'aba7ca58-35bf-433d-9946-42c46b76c9d1'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:04 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a" returned: 0 in 0.554s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:04 devstack sudo[89431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a
Apr 16 19:54:04 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:04 devstack sudo[89433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:04 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:05 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49" returned: 0 in 0.506s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:05 devstack sudo[89437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49
Apr 16 19:54:05 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:05 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1569be7d-3194-47d8-8007-dbad7f23df0a" returned: 0 in 0.432s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Lock "cinder-quobyte-1569be7d-3194-47d8-8007-dbad7f23df0a" released by "delete_volume" :: held 1.015s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:05 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.433s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:05 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Deleted volume successfully.
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-749f55ae-ed6b-4fa3-a1a4-2dbb90ab8ea3 tempest-VolumesTransfersV355Test-952128677 None] Lock "cinder-ba982fd1-6efa-4a03-b20f-7a5f7d2f1cc2-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Created reservations ['4b786c42-96a4-4efc-933a-f0c11e98c8e2', '84497126-950e-46c2-b24f-f8e05da4a888', 'a0a584a9-c95f-4c56-914a-777cacf2230d', '209daf47-d7b1-410f-b85d-efc0e8f478d2'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:05 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:05 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] Creating offline snapshot dfe55aa8-378b-4ad7-9143-b5cda58ae841 of volume 9d836b72-b511-4f87-b017-37ab3d792f68 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9bf390-90c1-49d4-889a-10b0982c8e04]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:05 devstack sudo[89446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68
Apr 16 19:54:05 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:05 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49" returned: 1 in 0.623s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.volume.volume_utils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Downloaded image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e ((None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}])) to volume 01541198-ff1e-47c9-bc2d-6367cc491f49 successfully. {{(pid=82616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Temporary image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e for user beb43ad1c4b04aa591d3928ad16096a9 is deleted. {{(pid=82616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.volume.volume_utils [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Marking volume 01541198-ff1e-47c9-bc2d-6367cc491f49 as bootable. {{(pid=82616) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Copying metadata from image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e to 01541198-ff1e-47c9-bc2d-6367cc491f49. {{(pid=82616) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Creating volume glance metadata for volume 01541198-ff1e-47c9-bc2d-6367cc491f49 backed by image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82616) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cd5232-b7c8-4d04-b53c-fbca9862ae78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01541198-ff1e-47c9-bc2d-6367cc491f49', 'volume_size': 1, 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94595a210065472391c483fcf54511ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'created_at': datetime.datetime(2026, 4, 16, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa358635ab0>}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be25db80-647e-4c35-823b-7dce5ba7876a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:05 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Volume volume-01541198-ff1e-47c9-bc2d-6367cc491f49 (01541198-ff1e-47c9-bc2d-6367cc491f49): created successfully
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be25db80-647e-4c35-823b-7dce5ba7876a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (e3715c25-a315-4f3f-9581-9659f4e769e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:05 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1f43699b-c2e4-4453-9773-35ff0e6ab6a0 tempest-VolumesGetTest-2085363863 None] Created volume successfully.
Apr 16 19:54:05 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.517s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:05 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Deleted volume successfully.
Apr 16 19:54:05 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-176b1630-7e54-4938-b76b-0b50d519947f tempest-CinderUnicodeTest-997147286 None] Lock "cinder-1569be7d-3194-47d8-8007-dbad7f23df0a-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:06 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68" returned: 0 in 0.550s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:06 devstack sudo[89452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841 1G
Apr 16 19:54:06 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Acquiring lock "cinder-541be004-0a69-4a62-a785-ba608c74f4a2-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Lock "cinder-541be004-0a69-4a62-a785-ba608c74f4a2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Acquiring lock "cinder-quobyte-541be004-0a69-4a62-a785-ba608c74f4a2" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Lock "cinder-quobyte-541be004-0a69-4a62-a785-ba608c74f4a2" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:06 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d6d68b-3085-4e8c-b6be-771bd966ee37]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-541be004-0a69-4a62-a785-ba608c74f4a2 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:06 devstack sudo[89454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-541be004-0a69-4a62-a785-ba608c74f4a2
Apr 16 19:54:06 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:06 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841 1G" returned: 0 in 0.602s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d836b72-b511-4f87-b017-37ab3d792f68 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:06 devstack sudo[89459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d836b72-b511-4f87-b017-37ab3d792f68 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841
Apr 16 19:54:06 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (a7185d4d-cb8f-49c9-8f09-b18407959e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda8a269-732c-455a-b1f4-285aaf123dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda8a269-732c-455a-b1f4-285aaf123dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1704929602',display_name='tempest-VolumesGetTest-Volume-1133995024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7509c1c8-69a4-4012-b097-e32ab101e2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c6361144b541e0aeb112b8d6e8fdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:07Z,use_quota=True,user_id='beb43ad1c4b04aa591d3928ad16096a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef893550-2f71-4f3e-82ba-6c133eb11cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef893550-2f71-4f3e-82ba-6c133eb11cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ed18c7-8670-4b38-9900-2eac872da850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:07 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ed18c7-8670-4b38-9900-2eac872da850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7509c1c8-69a4-4012-b097-e32ab101e2c7', 'volume_name': 'volume-7509c1c8-69a4-4012-b097-e32ab101e2c7', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0468fd0b-af41-4704-8f3b-37ba6ef74db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0468fd0b-af41-4704-8f3b-37ba6ef74db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ebb487-82ae-4d2a-8e7b-498742cacdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:07 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Volume 7509c1c8-69a4-4012-b097-e32ab101e2c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7509c1c8-69a4-4012-b097-e32ab101e2c7', 'volume_size': 1}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-541be004-0a69-4a62-a785-ba608c74f4a2" returned: 0 in 0.739s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-541be004-0a69-4a62-a785-ba608c74f4a2 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:07 devstack sudo[89464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-541be004-0a69-4a62-a785-ba608c74f4a2
Apr 16 19:54:07 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:07 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d836b72-b511-4f87-b017-37ab3d792f68 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841" returned: 0 in 0.496s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:07 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841 is being set with open permissions: ugo+rw
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:07 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841
Apr 16 19:54:07 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:07 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-541be004-0a69-4a62-a785-ba608c74f4a2" returned: 0 in 0.498s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Lock "cinder-quobyte-541be004-0a69-4a62-a785-ba608c74f4a2" released by "delete_volume" :: held 1.273s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Created reservations ['f44b34a1-f716-4ce8-bf33-d39585e44db6', '75a7b929-2ccf-4810-8266-888847b968b4', 'f88c65f9-f650-4603-a1ae-c1459cda379a', 'afb23e34-d3f9-4492-9079-ed1af3bae298'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:07 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841" returned: 0 in 0.483s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:07 devstack sudo[89473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:07 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:07 devstack sudo[89475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.info
Apr 16 19:54:07 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:08 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.438s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:08 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Deleted volume successfully.
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-41468487-9d20-4b4d-9d38-8eb6abea07d4 tempest-CinderUnicodeTest-997147286 None] Lock "cinder-541be004-0a69-4a62-a785-ba608c74f4a2-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:08 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.info" returned: 0 in 0.475s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:08 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.info is being set with open permissions: ugo+rw
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:08 devstack sudo[89481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.info
Apr 16 19:54:08 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:08 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.info" returned: 0 in 0.517s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.187s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.648s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1704929602',display_name='tempest-VolumesGetTest-Volume-1133995024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7509c1c8-69a4-4012-b097-e32ab101e2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c6361144b541e0aeb112b8d6e8fdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:07Z,use_quota=True,user_id='beb43ad1c4b04aa591d3928ad16096a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Creating volume 7509c1c8-69a4-4012-b097-e32ab101e2c7 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:54:08 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:54:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7509c1c8-69a4-4012-b097-e32ab101e2c7 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:08 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7509c1c8-69a4-4012-b097-e32ab101e2c7 1073741824
Apr 16 19:54:08 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:08 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a21b573a-057a-44f0-9dc5-f0a380fc544e tempest-VolumesSnapshotTestJSON-1302484543 None] Create snapshot completed successfully
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Flow 'volume_create_manager' (9b44fbcb-116c-426d-971f-d03b20d38762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c011ae-65c2-4d55-ba56-ee5eac034075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c011ae-65c2-4d55-ba56-ee5eac034075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-132234815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b8ba3a-4ebe-4d52-bfbb-881311ee4714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcb19449b344c7f849a1596fba201ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:09Z,use_quota=True,user_id='56647d85110e40bda6895c2bafbe14a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffa89c6-df89-4cff-90f3-732143a65980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffa89c6-df89-4cff-90f3-732143a65980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d604199-4f77-4832-92d9-8eb3ac14bc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d604199-4f77-4832-92d9-8eb3ac14bc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b8ba3a-4ebe-4d52-bfbb-881311ee4714', 'volume_name': 'volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e855a9-05f6-48fb-a847-da295b782aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e855a9-05f6-48fb-a847-da295b782aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e1db4e-71ca-4105-b52c-aff3db1f69db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:09 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Volume 30b8ba3a-4ebe-4d52-bfbb-881311ee4714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714', 'volume_size': 1}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:09 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7509c1c8-69a4-4012-b097-e32ab101e2c7 1073741824" returned: 0 in 0.545s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7509c1c8-69a4-4012-b097-e32ab101e2c7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:09 devstack sudo[89489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7509c1c8-69a4-4012-b097-e32ab101e2c7
Apr 16 19:54:09 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:09 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7509c1c8-69a4-4012-b097-e32ab101e2c7" returned: 0 in 0.474s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-132234815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b8ba3a-4ebe-4d52-bfbb-881311ee4714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcb19449b344c7f849a1596fba201ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:09Z,use_quota=True,user_id='56647d85110e40bda6895c2bafbe14a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Creating volume 30b8ba3a-4ebe-4d52-bfbb-881311ee4714 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:54:09 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ebb487-82ae-4d2a-8e7b-498742cacdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7509c1c8-69a4-4012-b097-e32ab101e2c7', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:09 devstack sudo[89492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 1073741824
Apr 16 19:54:09 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ceb039-447b-4546-90b5-694b87e622ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:09 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Volume volume-7509c1c8-69a4-4012-b097-e32ab101e2c7 (7509c1c8-69a4-4012-b097-e32ab101e2c7): created successfully
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ceb039-447b-4546-90b5-694b87e622ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Flow 'volume_create_manager' (a7185d4d-cb8f-49c9-8f09-b18407959e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:09 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-4af292ea-d16a-4d5e-ad34-8f860442de87 tempest-VolumesGetTest-2085363863 None] Created volume successfully.
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Flow 'volume_create_manager' (153c448f-655d-47b7-ac13-a495cfc34b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542afcd1-d96b-4f84-ae67-c149c244ca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542afcd1-d96b-4f84-ae67-c149c244ca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-507570735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04dda403-d4dd-442a-9655-2cbf108ebaa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f66bf9259c4f1ca1ae455ecded6c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dfe55aa8-378b-4ad7-9143-b5cda58ae841,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:10Z,use_quota=True,user_id='e50db9f51e1d4d88a194ae765f631ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4451d1a7-c3fe-4028-b24e-7202c8104b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4451d1a7-c3fe-4028-b24e-7202c8104b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7d25de-4aaa-4b50-9f82-cbd0eaf09037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7d25de-4aaa-4b50-9f82-cbd0eaf09037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '04dda403-d4dd-442a-9655-2cbf108ebaa8', 'volume_name': 'volume-04dda403-d4dd-442a-9655-2cbf108ebaa8', 'volume_size': 1, 'snapshot_id': 'dfe55aa8-378b-4ad7-9143-b5cda58ae841'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7d60f3-876c-4b27-a9d0-e77d01f60421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7d60f3-876c-4b27-a9d0-e77d01f60421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1f64ec-4810-4dbc-ad14-fc13f04c8a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:10 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Volume 04dda403-d4dd-442a-9655-2cbf108ebaa8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-04dda403-d4dd-442a-9655-2cbf108ebaa8', 'volume_size': 1, 'snapshot_id': 'dfe55aa8-378b-4ad7-9143-b5cda58ae841'}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-7509c1c8-69a4-4012-b097-e32ab101e2c7-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Lock "cinder-7509c1c8-69a4-4012-b097-e32ab101e2c7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-quobyte-7509c1c8-69a4-4012-b097-e32ab101e2c7" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-7509c1c8-69a4-4012-b097-e32ab101e2c7" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:10 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 1073741824" returned: 0 in 0.514s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f141d31-0c7a-40e1-af65-b40db3a63f24]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7509c1c8-69a4-4012-b097-e32ab101e2c7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:10 devstack sudo[89498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714
Apr 16 19:54:10 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:10 devstack sudo[89497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7509c1c8-69a4-4012-b097-e32ab101e2c7
Apr 16 19:54:10 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:10 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714" returned: 0 in 0.413s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.663s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-dfe55aa8-378b-4ad7-9143-b5cda58ae841-04dda403-d4dd-442a-9655-2cbf108ebaa8" by "_create_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e1db4e-71ca-4105-b52c-aff3db1f69db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b7446c-5db0-4526-a5d7-6b456aafbc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-dfe55aa8-378b-4ad7-9143-b5cda58ae841-04dda403-d4dd-442a-9655-2cbf108ebaa8" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Creating volume 04dda403-d4dd-442a-9655-2cbf108ebaa8 from snapshot dfe55aa8-378b-4ad7-9143-b5cda58ae841 {{(pid=82616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-04dda403-d4dd-442a-9655-2cbf108ebaa8" by "_copy_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:10 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Volume volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 (30b8ba3a-4ebe-4d52-bfbb-881311ee4714): created successfully
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b7446c-5db0-4526-a5d7-6b456aafbc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Flow 'volume_create_manager' (9b44fbcb-116c-426d-971f-d03b20d38762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:10 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c64423c2-dbfb-457e-b66e-210d2d6361e5 tempest-VolumesCloneTest-1172420362 None] Created volume successfully.
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-04dda403-d4dd-442a-9655-2cbf108ebaa8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] snapshot: dfe55aa8-378b-4ad7-9143-b5cda58ae841, volume: 04dda403-d4dd-442a-9655-2cbf108ebaa8,  {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 19:54:10 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7509c1c8-69a4-4012-b097-e32ab101e2c7" returned: 0 in 0.499s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7509c1c8-69a4-4012-b097-e32ab101e2c7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:10 devstack sudo[89505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7509c1c8-69a4-4012-b097-e32ab101e2c7
Apr 16 19:54:10 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a18a52-aca2-46a6-b0a8-5a672aa962d3]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:11 devstack sudo[89507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841
Apr 16 19:54:11 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:11 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-7509c1c8-69a4-4012-b097-e32ab101e2c7" returned: 0 in 0.435s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-7509c1c8-69a4-4012-b097-e32ab101e2c7" released by "delete_volume" :: held 0.960s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Created reservations ['e0e1a614-73fb-4630-a22e-96fcfb578593', 'b27b0f0d-496b-4450-93c5-1086e5fd9ae0', '90b268be-d76e-4f5f-8da1-1633adeb8979', '1eb8533b-51e4-429f-8d4d-f754e567bfef'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:11 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841" returned: 0 in 0.504s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d836b72-b511-4f87-b017-37ab3d792f68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Creating direct copy from snapshot {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dec0f0d-e013-4492-a325-73f58dd253aa]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:11 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:11 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_service.periodic_task [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82616) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:11 devstack sudo[89516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:11 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-01541198-ff1e-47c9-bc2d-6367cc491f49-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:11 devstack sudo[89514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68
Apr 16 19:54:11 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Lock "cinder-01541198-ff1e-47c9-bc2d-6367cc491f49-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Flow 'volume_create_manager' (edf597de-24fe-4c7b-ab1f-33266cfcd532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d049a6-374a-4061-8999-8c263add68b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d049a6-374a-4061-8999-8c263add68b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-824410536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a33f01-d961-45c8-8fc4-972f865be6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcb19449b344c7f849a1596fba201ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=30b8ba3a-4ebe-4d52-bfbb-881311ee4714,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:12Z,use_quota=True,user_id='56647d85110e40bda6895c2bafbe14a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bfb892-6115-4a7c-83fe-c3b946c0d1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bfb892-6115-4a7c-83fe-c3b946c0d1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f1c38c-014c-4e11-a6ee-94083aea9147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f1c38c-014c-4e11-a6ee-94083aea9147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd9a33f01-d961-45c8-8fc4-972f865be6a3', 'volume_name': 'volume-d9a33f01-d961-45c8-8fc4-972f865be6a3', 'volume_size': 2, 'source_volid': '30b8ba3a-4ebe-4d52-bfbb-881311ee4714', 'source_volstatus': 'available'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5962362d-cc69-47b4-90bf-609061a9c1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5962362d-cc69-47b4-90bf-609061a9c1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed1b94e-2fc3-43b5-8260-c28944a77ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:11 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Volume d9a33f01-d961-45c8-8fc4-972f865be6a3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d9a33f01-d961-45c8-8fc4-972f865be6a3', 'volume_size': 2, 'source_volid': '30b8ba3a-4ebe-4d52-bfbb-881311ee4714', 'source_volstatus': 'available'}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Acquiring lock "cinder-quobyte-01541198-ff1e-47c9-bc2d-6367cc491f49" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-01541198-ff1e-47c9-bc2d-6367cc491f49" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8150fcd2-1a9e-4ec9-8a85-c15497d45d61]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:11 devstack sudo[89519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49
Apr 16 19:54:11 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:11 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.479s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:11 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Deleted volume successfully.
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7fa085ee-1e71-48f7-a36f-ba61e0a09373 tempest-VolumesGetTest-2085363863 None] Lock "cinder-7509c1c8-69a4-4012-b097-e32ab101e2c7-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:11 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.485s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:11 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:12 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68" returned: 0 in 0.576s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:12 devstack cinder-volume[82616]: DEBUG cinder.utils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Path /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8 not found in is_blk_device check {{(pid=82616) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 19:54:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:12 devstack sudo[89526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8
Apr 16 19:54:12 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:12 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49" returned: 0 in 0.499s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:12 devstack sudo[89530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49
Apr 16 19:54:12 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:13 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49" returned: 1 in 1.254s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:54:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:13 devstack sudo[89546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49
Apr 16 19:54:13 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:14 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8" returned: 0 in 2.161s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bd9ff6-f211-4769-8229-dfd27b0c9cea]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:14 devstack sudo[89549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68
Apr 16 19:54:14 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:14 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-01541198-ff1e-47c9-bc2d-6367cc491f49" returned: 0 in 0.802s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Lock "cinder-quobyte-01541198-ff1e-47c9-bc2d-6367cc491f49" released by "delete_volume" :: held 2.605s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Created reservations ['6678365c-ff5b-4915-8421-689c89ba6bb6', 'bc45b39f-eb74-4a10-a070-cb93f44afffb', 'da82885a-c803-43e9-aa7b-422cf2d92f5b', 'cce3eb35-56ab-46e2-8816-ce6b98e1af4c'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:14 devstack sudo[89551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:14 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:14 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.441s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:14 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Deleted volume successfully.
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b64eed23-02ea-474e-82dd-7f2377199682 tempest-VolumesGetTest-2085363863 None] Lock "cinder-01541198-ff1e-47c9-bc2d-6367cc491f49-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:14 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68" returned: 0 in 0.657s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:54:14 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Converted 1024.00 MB image at 473.52 MB/s
Apr 16 19:54:14 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8 is being set with open permissions: ugo+rw
Apr 16 19:54:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:14 devstack sudo[89558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8
Apr 16 19:54:14 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:15 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8" returned: 0 in 0.523s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-04dda403-d4dd-442a-9655-2cbf108ebaa8" released by "_copy_volume_from_snapshot" :: held 4.495s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-dfe55aa8-378b-4ad7-9143-b5cda58ae841-04dda403-d4dd-442a-9655-2cbf108ebaa8" released by "_create_volume_from_snapshot" :: held 4.526s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.549s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.732s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:15 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Cloning volume 30b8ba3a-4ebe-4d52-bfbb-881311ee4714 to volume d9a33f01-d961-45c8-8fc4-972f865be6a3
Apr 16 19:54:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1f64ec-4810-4dbc-ad14-fc13f04c8a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04dda403-d4dd-442a-9655-2cbf108ebaa8', 'volume_size': 1, 'snapshot_id': 'dfe55aa8-378b-4ad7-9143-b5cda58ae841'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54024f92-30ab-42fd-89e9-77821444753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:15 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Volume volume-04dda403-d4dd-442a-9655-2cbf108ebaa8 (04dda403-d4dd-442a-9655-2cbf108ebaa8): created successfully
Apr 16 19:54:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54024f92-30ab-42fd-89e9-77821444753c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Flow 'volume_create_manager' (153c448f-655d-47b7-ac13-a495cfc34b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Creating offline snapshot 27ae9167-74e8-47b9-b43f-b46bdfe990c7 of volume 30b8ba3a-4ebe-4d52-bfbb-881311ee4714 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:54:15 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e75d1ac-3d7a-451d-b739-8c239e970b50]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:15 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-87be2977-9d72-45fa-9a7c-92c26dd77faf tempest-VolumesSnapshotTestJSON-1302484543 None] Created volume successfully.
Apr 16 19:54:15 devstack sudo[89561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714
Apr 16 19:54:15 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:16 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714" returned: 0 in 0.547s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:16 devstack sudo[89566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7 1G
Apr 16 19:54:16 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:16 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-04dda403-d4dd-442a-9655-2cbf108ebaa8-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:16 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-04dda403-d4dd-442a-9655-2cbf108ebaa8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:16 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-04dda403-d4dd-442a-9655-2cbf108ebaa8" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:16 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-04dda403-d4dd-442a-9655-2cbf108ebaa8" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:16 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7 1G" returned: 0 in 0.623s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:16 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acd4a5b-9294-4625-9f65-f7823f704b36]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:16 devstack sudo[89571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7
Apr 16 19:54:16 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:16 devstack sudo[89572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8
Apr 16 19:54:16 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:17 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7" returned: 0 in 0.481s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:17 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7 is being set with open permissions: ugo+rw
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:17 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7
Apr 16 19:54:17 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:17 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8" returned: 0 in 0.572s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:17 devstack sudo[89583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8
Apr 16 19:54:17 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:17 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7" returned: 0 in 0.473s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:17 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.info
Apr 16 19:54:17 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:17 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-04dda403-d4dd-442a-9655-2cbf108ebaa8" returned: 0 in 0.443s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-04dda403-d4dd-442a-9655-2cbf108ebaa8" released by "delete_volume" :: held 1.064s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Created reservations ['735bb7ee-e41a-4ffc-a9e0-1bf0effd8f50', 'b4c2dfd1-fc7b-429d-afa7-3e95bc925cff', 'efd117b9-c96a-43b5-9dcb-4b80856edcef', 'c7c49a8e-2454-4b23-80d9-410e6b37daa5'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:17 devstack sudo[89589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:17 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:18 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.info" returned: 0 in 0.456s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:18 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.info is being set with open permissions: ugo+rw
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:18 devstack sudo[89592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.info
Apr 16 19:54:18 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:18 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.471s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:18 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Deleted volume successfully.
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9eae1b48-f093-4e55-b04f-e4167b128656 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-04dda403-d4dd-442a-9655-2cbf108ebaa8-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:18 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.info" returned: 0 in 0.488s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Acquiring lock "cinder-quobyte-d9a33f01-d961-45c8-8fc4-972f865be6a3" by "_copy_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Lock "cinder-quobyte-d9a33f01-d961-45c8-8fc4-972f865be6a3" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] snapshot: 27ae9167-74e8-47b9-b43f-b46bdfe990c7, volume: d9a33f01-d961-45c8-8fc4-972f865be6a3,  {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb767f4-d293-40a8-9dfe-77c09d8eff10]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:18 devstack sudo[89596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7
Apr 16 19:54:18 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-dfe55aa8-378b-4ad7-9143-b5cda58ae841-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-dfe55aa8-378b-4ad7-9143-b5cda58ae841-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-9d836b72-b511-4f87-b017-37ab3d792f68" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-9d836b72-b511-4f87-b017-37ab3d792f68" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-dfe55aa8-378b-4ad7-9143-b5cda58ae841" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-dfe55aa8-378b-4ad7-9143-b5cda58ae841" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Deleting offline snapshot dfe55aa8-378b-4ad7-9143-b5cda58ae841 of volume 9d836b72-b511-4f87-b017-37ab3d792f68 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] snapshot_file for this snap is: volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eb7ca2-7496-45f2-9b0a-a6b1563be817]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:18 devstack sudo[89598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841
Apr 16 19:54:18 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:19 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7" returned: 0 in 0.576s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Creating direct copy from snapshot {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6544c2c9-b38c-40aa-9f71-aa9b4c13ba57]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:19 devstack sudo[89603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714
Apr 16 19:54:19 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:19 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841" returned: 0 in 0.561s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d836b72-b511-4f87-b017-37ab3d792f68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeba5d1e-c72b-4aee-9db2-af0e6a8b7a89]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:19 devstack sudo[89608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68
Apr 16 19:54:19 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:19 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714" returned: 0 in 0.513s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG cinder.utils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Path /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3 not found in is_blk_device check {{(pid=82616) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:19 devstack sudo[89613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3
Apr 16 19:54:19 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:19 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68" returned: 0 in 0.558s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:20 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841
Apr 16 19:54:20 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:21 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841" returned: 0 in 1.244s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:21 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841
Apr 16 19:54:21 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:22 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3" returned: 0 in 2.294s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:22 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[833f91a3-2544-41a0-8411-856be69c02db]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:22 devstack sudo[89636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714
Apr 16 19:54:22 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:22 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68.dfe55aa8-378b-4ad7-9143-b5cda58ae841" returned: 0 in 0.880s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-dfe55aa8-378b-4ad7-9143-b5cda58ae841" released by "_delete_snapshot" :: held 3.304s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-9d836b72-b511-4f87-b017-37ab3d792f68" released by "delete_snapshot" :: held 3.316s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:22 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=198,cinder:UPDATE=206,cinder:INSERT=75,cinder:DELETE=15 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:54:22 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Created reservations ['55a7a14c-2448-4806-838b-c056e461ecb4', 'e253907a-94d6-4789-af19-2e18ef79c8d0', 'bac0f336-36ce-4157-aa4e-a93a0a0e2e31', '55bd524d-4e37-4963-8fee-1d215f8815dd'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:22 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Delete snapshot completed successfully.
Apr 16 19:54:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36839bb5-a3cc-469b-8604-d68ae3bac29a tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-dfe55aa8-378b-4ad7-9143-b5cda58ae841-delete_snapshot" released by "delete_snapshot" :: held 3.406s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:22 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714" returned: 0 in 0.671s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:22 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:54:22 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Converted 1024.00 MB image at 446.18 MB/s
Apr 16 19:54:22 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3 is being set with open permissions: ugo+rw
Apr 16 19:54:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:22 devstack sudo[89641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3
Apr 16 19:54:22 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-9d836b72-b511-4f87-b017-37ab3d792f68-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-9d836b72-b511-4f87-b017-37ab3d792f68-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=159,cinder:INSERT=62,cinder:UPDATE=224,cinder:DELETE=22 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-9d836b72-b511-4f87-b017-37ab3d792f68" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-9d836b72-b511-4f87-b017-37ab3d792f68" acquired by "delete_volume" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bef0f0a-68fc-414d-aef2-595c1025f851]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:23 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3" returned: 0 in 0.453s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Lock "cinder-quobyte-d9a33f01-d961-45c8-8fc4-972f865be6a3" released by "_copy_volume_from_snapshot" :: held 4.555s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Acquiring lock "cinder-quobyte-27ae9167-74e8-47b9-b43f-b46bdfe990c7" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Lock "cinder-quobyte-27ae9167-74e8-47b9-b43f-b46bdfe990c7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Deleting offline snapshot 27ae9167-74e8-47b9-b43f-b46bdfe990c7 of volume 30b8ba3a-4ebe-4d52-bfbb-881311ee4714 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] snapshot_file for this snap is: volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a670f3-78dc-49b4-8c1c-5c42454e20b0]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:23 devstack sudo[89644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68
Apr 16 19:54:23 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:23 devstack sudo[89645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7
Apr 16 19:54:23 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:23 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68" returned: 0 in 0.539s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:23 devstack sudo[89654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68
Apr 16 19:54:23 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:23 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7" returned: 0 in 0.565s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa45066e-3a77-40f2-8ad6-74f2be5567a4]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:23 devstack sudo[89656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714
Apr 16 19:54:23 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:24 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d836b72-b511-4f87-b017-37ab3d792f68" returned: 0 in 0.453s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-9d836b72-b511-4f87-b017-37ab3d792f68" released by "delete_volume" :: held 1.034s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Created reservations ['84063809-9030-4b06-97b5-2656b1c5e92b', 'a39c4eb8-c533-439a-9f3b-795d7621c472', '7ff36fc7-3e27-4edb-8a20-1a1e7fbb3ebe', '08bb4ca6-79d8-4fb2-9ad6-37dc709ca2fb'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:24 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:24 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:24 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714" returned: 0 in 0.602s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:24 devstack sudo[89664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7
Apr 16 19:54:24 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:24 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.520s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:24 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Deleted volume successfully.
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-231ab9e8-f46e-48fe-a83b-a3135086dc90 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-9d836b72-b511-4f87-b017-37ab3d792f68-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:24 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7" returned: 0 in 0.561s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:24 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7
Apr 16 19:54:24 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-b98d1d9b-421f-4e6b-a255-544c9c1b59bf-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-b98d1d9b-421f-4e6b-a255-544c9c1b59bf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "cinder-quobyte-b98d1d9b-421f-4e6b-a255-544c9c1b59bf" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-b98d1d9b-421f-4e6b-a255-544c9c1b59bf" acquired by "delete_volume" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:25 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714.27ae9167-74e8-47b9-b43f-b46bdfe990c7" returned: 0 in 0.522s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:25 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[381ed9b2-f130-4400-a888-72c0f49692a1]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Lock "cinder-quobyte-27ae9167-74e8-47b9-b43f-b46bdfe990c7" released by "_delete_snapshot" :: held 2.309s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.114s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed1b94e-2fc3-43b5-8260-c28944a77ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a33f01-d961-45c8-8fc4-972f865be6a3', 'volume_size': 2, 'source_volid': '30b8ba3a-4ebe-4d52-bfbb-881311ee4714', 'source_volstatus': 'available'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2dc9898-6da2-459c-85b4-d423a623087c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:25 devstack sudo[89674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf
Apr 16 19:54:25 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:25 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Volume volume-d9a33f01-d961-45c8-8fc4-972f865be6a3 (d9a33f01-d961-45c8-8fc4-972f865be6a3): created successfully
Apr 16 19:54:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2dc9898-6da2-459c-85b4-d423a623087c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:25 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Flow 'volume_create_manager' (edf597de-24fe-4c7b-ab1f-33266cfcd532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:25 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ecfc9d13-fc85-444b-87f8-9f801f5796cf tempest-VolumesCloneTest-1172420362 None] Created volume successfully.
Apr 16 19:54:26 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf" returned: 0 in 0.546s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:26 devstack sudo[89680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf
Apr 16 19:54:26 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:26 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-b98d1d9b-421f-4e6b-a255-544c9c1b59bf" returned: 0 in 0.433s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-quobyte-b98d1d9b-421f-4e6b-a255-544c9c1b59bf" released by "delete_volume" :: held 1.039s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Created reservations ['0ecf6192-98cb-4185-9173-feaea817161d', 'b3c43d38-f656-4690-858f-3e8f32a62046', '3e597a76-5460-435e-b898-65af90e24db9', '73bc1bc8-6e1d-4ecd-bd07-afffded3e028'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:26 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:26 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Acquiring lock "cinder-d9a33f01-d961-45c8-8fc4-972f865be6a3-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Lock "cinder-d9a33f01-d961-45c8-8fc4-972f865be6a3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Acquiring lock "cinder-quobyte-d9a33f01-d961-45c8-8fc4-972f865be6a3" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Lock "cinder-quobyte-d9a33f01-d961-45c8-8fc4-972f865be6a3" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4259f01-d9ec-4712-acd2-bc9e35ef0442]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:26 devstack sudo[89685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3
Apr 16 19:54:26 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:27 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.506s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:27 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Deleted volume successfully.
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-673e786b-787b-44aa-a9c5-b777522ccfc3 tempest-VolumesSnapshotTestJSON-1302484543 None] Lock "cinder-b98d1d9b-421f-4e6b-a255-544c9c1b59bf-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:27 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3" returned: 0 in 0.509s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:27 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3
Apr 16 19:54:27 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:27 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-d9a33f01-d961-45c8-8fc4-972f865be6a3" returned: 0 in 0.500s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Lock "cinder-quobyte-d9a33f01-d961-45c8-8fc4-972f865be6a3" released by "delete_volume" :: held 1.037s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Created reservations ['93119151-6a76-4e00-9ce4-93075f1b0bc7', '1bbbd0b0-53d2-446f-a6bf-85cd5bf99aeb', '94aea7c6-2ca9-462e-b9d0-3a53001e8192', '96bd1044-6fb1-4071-978d-07d4493593fd'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:27 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:27 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:28 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.558s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:28 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:28 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Deleted volume successfully.
Apr 16 19:54:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-e2e362e0-377b-4808-9ef5-24a11c57e8f0 tempest-VolumesCloneTest-1172420362 None] Lock "cinder-d9a33f01-d961-45c8-8fc4-972f865be6a3-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Acquiring lock "cinder-30b8ba3a-4ebe-4d52-bfbb-881311ee4714-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Lock "cinder-30b8ba3a-4ebe-4d52-bfbb-881311ee4714-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Acquiring lock "cinder-quobyte-30b8ba3a-4ebe-4d52-bfbb-881311ee4714" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Lock "cinder-quobyte-30b8ba3a-4ebe-4d52-bfbb-881311ee4714" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:29 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1660694f-9e3d-4a62-8630-429fc6057d06]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:29 devstack sudo[89698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714
Apr 16 19:54:29 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:29 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714" returned: 0 in 0.584s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:29 devstack sudo[89703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714
Apr 16 19:54:29 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:30 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-30b8ba3a-4ebe-4d52-bfbb-881311ee4714" returned: 0 in 0.555s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Lock "cinder-quobyte-30b8ba3a-4ebe-4d52-bfbb-881311ee4714" released by "delete_volume" :: held 1.183s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:30 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Created reservations ['b712f68a-c250-4b22-ab49-47b5911903e3', '1ee7d096-ab58-4874-9704-8011e5da45f5', '06c5aea0-0fe2-48eb-939e-5ceee446ad7b', '2c309a2d-d672-43e3-89f8-f2b4570e72d4'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:30 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:30 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:30 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.511s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:30 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:30 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Deleted volume successfully.
Apr 16 19:54:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-c1d767c5-2579-43de-80d5-135c76d67bb8 tempest-VolumesCloneTest-1172420362 None] Lock "cinder-30b8ba3a-4ebe-4d52-bfbb-881311ee4714-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Flow 'volume_create_manager' (fe7be0aa-5766-4dea-a881-889c39756fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432fbb6d-c54b-4f8c-9df3-6785ee6be648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432fbb6d-c54b-4f8c-9df3-6785ee6be648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-971386346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f53fe33-fab7-4c13-9796-8fa9e8f5b59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a1358cbe7c4674979041ff96062d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:32Z,use_quota=True,user_id='a47e71014f314e049205775da036692c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0f257f-e736-4a36-9ce5-e56f818ef5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0f257f-e736-4a36-9ce5-e56f818ef5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b93d3c6-7f13-4895-a3fd-a5a9031ffdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b93d3c6-7f13-4895-a3fd-a5a9031ffdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f53fe33-fab7-4c13-9796-8fa9e8f5b59b', 'volume_name': 'volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b', 'volume_size': 2}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d3370f-4627-4a76-a72c-5aa9d431e7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d3370f-4627-4a76-a72c-5aa9d431e7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0cd7c8-20ea-4b1a-be06-e116f9453507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:32 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Volume 1f53fe33-fab7-4c13-9796-8fa9e8f5b59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b', 'volume_size': 2}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-971386346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f53fe33-fab7-4c13-9796-8fa9e8f5b59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a1358cbe7c4674979041ff96062d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:32Z,use_quota=True,user_id='a47e71014f314e049205775da036692c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Creating volume 1f53fe33-fab7-4c13-9796-8fa9e8f5b59b {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:54:32 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:54:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b 2147483648 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:32 devstack sudo[89717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b 2147483648
Apr 16 19:54:32 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Flow 'volume_create_manager' (884d9622-2b3e-41ee-a108-8e5c19bf3cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de4594e-0b90-44b1-ab6d-f14daacf1a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de4594e-0b90-44b1-ab6d-f14daacf1a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-375457579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e699906d-279a-443c-9338-cda79afbba9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37654df8ec794ceb9aa2e8e967e073de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:33Z,use_quota=True,user_id='f4663f025d2b4f51b0548a1932319c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9acde7-b01d-48e7-a694-911499a690c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9acde7-b01d-48e7-a694-911499a690c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff1cf61-ab7c-4caa-8e80-5cc87ceae887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff1cf61-ab7c-4caa-8e80-5cc87ceae887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e699906d-279a-443c-9338-cda79afbba9b', 'volume_name': 'volume-e699906d-279a-443c-9338-cda79afbba9b', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f2a5e1-fb21-4362-968a-cd595ea2f315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f2a5e1-fb21-4362-968a-cd595ea2f315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1583d871-cbfe-49f4-836b-a5e8d53faa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:33 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Volume e699906d-279a-443c-9338-cda79afbba9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e699906d-279a-443c-9338-cda79afbba9b', 'volume_size': 1}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:33 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b 2147483648" returned: 0 in 0.640s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:33 devstack sudo[89722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b
Apr 16 19:54:33 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:33 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b" returned: 0 in 0.488s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-375457579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e699906d-279a-443c-9338-cda79afbba9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37654df8ec794ceb9aa2e8e967e073de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:33Z,use_quota=True,user_id='f4663f025d2b4f51b0548a1932319c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Creating volume e699906d-279a-443c-9338-cda79afbba9b {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:54:33 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0cd7c8-20ea-4b1a-be06-e116f9453507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b', 'volume_size': 2}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:33 devstack sudo[89725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b 1073741824
Apr 16 19:54:33 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f50454-57e4-47c4-8d10-7ce906ef37fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:33 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Volume volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b (1f53fe33-fab7-4c13-9796-8fa9e8f5b59b): created successfully
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f50454-57e4-47c4-8d10-7ce906ef37fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Flow 'volume_create_manager' (fe7be0aa-5766-4dea-a881-889c39756fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:33 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-bbc0d5ac-2eac-45e1-8ef1-3aa8d2a4ae70 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Created volume successfully.
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Flow 'volume_create_manager' (6e993d27-1837-4dcc-889d-f83b5faafd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4963bba-109e-4150-934b-c1fafde61f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4963bba-109e-4150-934b-c1fafde61f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-716992001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e5d24b-4866-44a9-9d82-a201373ae6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38642b47566244788af46db35f239244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:34Z,use_quota=True,user_id='b0ff8bd0720e40879194746339d39032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343785c2-fa25-4c4e-add4-f8b90d57e601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343785c2-fa25-4c4e-add4-f8b90d57e601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27b3f19-8c2b-43c8-ad32-7e6103166bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27b3f19-8c2b-43c8-ad32-7e6103166bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e5d24b-4866-44a9-9d82-a201373ae6a6', 'volume_name': 'volume-26e5d24b-4866-44a9-9d82-a201373ae6a6', 'volume_size': 2}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ba2a11-8950-4eb7-b0a5-c1b29b385684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ba2a11-8950-4eb7-b0a5-c1b29b385684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104ef8ca-4b72-489d-82aa-3b0c34b509bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:33 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Volume 26e5d24b-4866-44a9-9d82-a201373ae6a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e5d24b-4866-44a9-9d82-a201373ae6a6', 'volume_size': 2}
Apr 16 19:54:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:34 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b 1073741824" returned: 0 in 0.525s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:34 devstack sudo[89730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b
Apr 16 19:54:34 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:34 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b" returned: 0 in 0.457s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.707s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-716992001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e5d24b-4866-44a9-9d82-a201373ae6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38642b47566244788af46db35f239244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:34Z,use_quota=True,user_id='b0ff8bd0720e40879194746339d39032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Creating volume 26e5d24b-4866-44a9-9d82-a201373ae6a6 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:54:34 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-26e5d24b-4866-44a9-9d82-a201373ae6a6 2147483648 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1583d871-cbfe-49f4-836b-a5e8d53faa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e699906d-279a-443c-9338-cda79afbba9b', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:34 devstack sudo[89734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-26e5d24b-4866-44a9-9d82-a201373ae6a6 2147483648
Apr 16 19:54:34 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b880ad90-3881-47b9-b378-efe21a945316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:34 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Volume volume-e699906d-279a-443c-9338-cda79afbba9b (e699906d-279a-443c-9338-cda79afbba9b): created successfully
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b880ad90-3881-47b9-b378-efe21a945316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:34 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Flow 'volume_create_manager' (884d9622-2b3e-41ee-a108-8e5c19bf3cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:34 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-6238c3a2-8d6a-40a1-8fdb-ce2d073ba3a1 tempest-SnapshotDependencyTests-703089766 None] Created volume successfully.
Apr 16 19:54:35 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-26e5d24b-4866-44a9-9d82-a201373ae6a6 2147483648" returned: 0 in 0.530s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-26e5d24b-4866-44a9-9d82-a201373ae6a6 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:35 devstack sudo[89739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-26e5d24b-4866-44a9-9d82-a201373ae6a6
Apr 16 19:54:35 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:35 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-26e5d24b-4866-44a9-9d82-a201373ae6a6" returned: 0 in 0.428s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.056s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104ef8ca-4b72-489d-82aa-3b0c34b509bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e5d24b-4866-44a9-9d82-a201373ae6a6', 'volume_size': 2}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e3ee4a-b6a3-4770-888c-f631f6682499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Creating offline snapshot 57c17734-29f4-40fc-9e77-56659cc96e66 of volume 1f53fe33-fab7-4c13-9796-8fa9e8f5b59b {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:54:35 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Volume volume-26e5d24b-4866-44a9-9d82-a201373ae6a6 (26e5d24b-4866-44a9-9d82-a201373ae6a6): created successfully
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e3ee4a-b6a3-4770-888c-f631f6682499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Flow 'volume_create_manager' (6e993d27-1837-4dcc-889d-f83b5faafd4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa45a5f-946d-460d-9836-5b86cf06fa04]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:35 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-8f872d3a-cfdb-48f1-8f64-bae7ac546f7a tempest-VolumesCloneNegativeTest-517620389 None] Created volume successfully.
Apr 16 19:54:35 devstack sudo[89742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b
Apr 16 19:54:35 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Acquiring lock "cinder-26e5d24b-4866-44a9-9d82-a201373ae6a6-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Lock "cinder-26e5d24b-4866-44a9-9d82-a201373ae6a6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Acquiring lock "cinder-quobyte-26e5d24b-4866-44a9-9d82-a201373ae6a6" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:36 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Lock "cinder-quobyte-26e5d24b-4866-44a9-9d82-a201373ae6a6" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:36 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[747b38dd-eca8-48fc-a52d-c865f6b253d1]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-26e5d24b-4866-44a9-9d82-a201373ae6a6 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:36 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b" returned: 0 in 0.503s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66 2G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:36 devstack sudo[89748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66 2G
Apr 16 19:54:36 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:36 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-26e5d24b-4866-44a9-9d82-a201373ae6a6
Apr 16 19:54:36 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:36 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-26e5d24b-4866-44a9-9d82-a201373ae6a6" returned: 0 in 0.496s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-26e5d24b-4866-44a9-9d82-a201373ae6a6 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:36 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66 2G" returned: 0 in 0.491s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:36 devstack sudo[89757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-26e5d24b-4866-44a9-9d82-a201373ae6a6
Apr 16 19:54:36 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:36 devstack sudo[89758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66
Apr 16 19:54:36 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:37 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-26e5d24b-4866-44a9-9d82-a201373ae6a6" returned: 0 in 0.401s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Lock "cinder-quobyte-26e5d24b-4866-44a9-9d82-a201373ae6a6" released by "delete_volume" :: held 0.919s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Created reservations ['e1bb7985-347e-4d68-95d1-74bc5bdccd99', 'bce92bc8-4d30-4179-b03e-b20567f43339', '21731aaa-d859-4668-8f5b-6627efbcf2de', '868b7d1a-9785-485a-bab9-0cd6ad32f0b9'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:37 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66" returned: 0 in 0.444s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:37 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66 is being set with open permissions: ugo+rw
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:37 devstack sudo[89765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66
Apr 16 19:54:37 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:37 devstack sudo[89767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:37 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:37 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66" returned: 0 in 0.500s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:37 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.515s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:37 devstack sudo[89771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.info
Apr 16 19:54:37 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:37 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Deleted volume successfully.
Apr 16 19:54:37 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4c8cf2ac-f046-4b30-b697-7c091c3b1a11 tempest-VolumesCloneNegativeTest-517620389 None] Lock "cinder-26e5d24b-4866-44a9-9d82-a201373ae6a6-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:38 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.info" returned: 0 in 0.476s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:38 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.info is being set with open permissions: ugo+rw
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:38 devstack sudo[89774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.info
Apr 16 19:54:38 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:38 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.info" returned: 0 in 0.479s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.979s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.395s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:38 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-de507a61-6abf-4de3-a45f-c1a4ba044688 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Create snapshot completed successfully
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] Creating offline snapshot 2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 of volume e699906d-279a-443c-9338-cda79afbba9b {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2783555-99a5-4c3e-91fd-01baf55807f1]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:38 devstack sudo[89777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b
Apr 16 19:54:38 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Acquiring lock "cinder-57c17734-29f4-40fc-9e77-56659cc96e66-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "cinder-57c17734-29f4-40fc-9e77-56659cc96e66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Acquiring lock "cinder-quobyte-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "cinder-quobyte-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Acquiring lock "cinder-quobyte-57c17734-29f4-40fc-9e77-56659cc96e66" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "cinder-quobyte-57c17734-29f4-40fc-9e77-56659cc96e66" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Deleting offline snapshot 57c17734-29f4-40fc-9e77-56659cc96e66 of volume 1f53fe33-fab7-4c13-9796-8fa9e8f5b59b {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] snapshot_file for this snap is: volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf1c48a-7588-405c-8f91-42dcdeb4e53f]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:38 devstack sudo[89779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66
Apr 16 19:54:38 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Flow 'volume_create_manager' (a043a9bb-38fa-41b8-958f-e1e96330cdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dae56f-3f7c-4661-8096-364e3a6e152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dae56f-3f7c-4661-8096-364e3a6e152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-428733750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f64dd452a941449bdae141c24afd8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:39Z,use_quota=True,user_id='ac26e0e4377f4e5b9cd5d49c73724838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b18b27b-9c66-4096-9eb5-e7847aff0a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b18b27b-9c66-4096-9eb5-e7847aff0a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff5c0ae-8c27-4262-8b55-229d5053828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.image.glance [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Creating Keystone auth plugin from conf {{(pid=82616) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 16 19:54:39 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b" returned: 0 in 0.678s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:39 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 1G
Apr 16 19:54:39 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:39 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66" returned: 0 in 0.569s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe61834-f1b0-4bfd-a0a7-d8f1cfc47d28]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff5c0ae-8c27-4262-8b55-229d5053828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26', 'volume_name': 'volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26', 'volume_size': 1, 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94595a210065472391c483fcf54511ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'created_at': datetime.datetime(2026, 4, 16, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa362a0a560>}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5accde8-77ca-45f2-8c14-229b01f5f8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5accde8-77ca-45f2-8c14-229b01f5f8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ac8645-a3b0-48cb-a6cc-2330d4cda11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:39 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Volume 257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26', 'volume_size': 1, 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94595a210065472391c483fcf54511ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'created_at': datetime.datetime(2026, 4, 16, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa362a0a560>}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Trying to clone 257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 from image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]). {{(pid=82616) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 16 19:54:39 devstack sudo[89789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b
Apr 16 19:54:39 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82616) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 16 19:54:39 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Image download 20.69 MB at 20.69 MB/s
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7613414-155c-4217-926c-2e8b55465131]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:39 devstack sudo[89792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD
Apr 16 19:54:39 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:39 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 1G" returned: 0 in 0.553s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e699906d-279a-443c-9338-cda79afbba9b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:39 devstack sudo[89800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e699906d-279a-443c-9338-cda79afbba9b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89
Apr 16 19:54:39 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:40 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b" returned: 0 in 0.556s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:40 devstack sudo[89802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66
Apr 16 19:54:40 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:40 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Temporary image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e is fetched for user ac26e0e4377f4e5b9cd5d49c73724838. {{(pid=82616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1329454f-625e-40a9-8d01-7f6a0d1eaf8a]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:40 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e699906d-279a-443c-9338-cda79afbba9b -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89" returned: 0 in 0.492s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:40 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 is being set with open permissions: ugo+rw
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:40 devstack sudo[89810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD
Apr 16 19:54:40 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:40 devstack sudo[89814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89
Apr 16 19:54:40 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:40 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66" returned: 0 in 0.498s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:40 devstack sudo[89817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66
Apr 16 19:54:40 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:40 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:40 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89" returned: 0 in 0.423s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:40 devstack sudo[89824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.info
Apr 16 19:54:40 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:40 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b.57c17734-29f4-40fc-9e77-56659cc96e66" returned: 0 in 0.431s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "cinder-quobyte-57c17734-29f4-40fc-9e77-56659cc96e66" released by "_delete_snapshot" :: held 2.111s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "cinder-quobyte-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b" released by "delete_snapshot" :: held 2.124s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Created reservations ['e55cdb24-7614-4e4e-9501-4c52aac32d26', '1ab62316-8feb-4d89-9edd-bb6cfd210c1d', '1cb2aa45-49c7-4c29-9911-84f9b55d4fe7', 'd3480274-dc1a-4d18-8108-a13d01aa2e5e'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:41 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Delete snapshot completed successfully.
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-36b71d35-fca1-4bca-b381-5887497a65d5 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "cinder-57c17734-29f4-40fc-9e77-56659cc96e66-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:41 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.info" returned: 0 in 0.423s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:41 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.info is being set with open permissions: ugo+rw
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:41 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.info
Apr 16 19:54:41 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:41 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.info" returned: 0 in 0.431s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.068s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.906s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-428733750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f64dd452a941449bdae141c24afd8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:39Z,use_quota=True,user_id='ac26e0e4377f4e5b9cd5d49c73724838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Creating volume 257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:54:41 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:54:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:41 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-4e6d7277-ca1a-4807-aae7-dc8450a8fd96 tempest-SnapshotDependencyTests-703089766 None] Create snapshot completed successfully
Apr 16 19:54:41 devstack sudo[89830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 1073741824
Apr 16 19:54:41 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Acquiring lock "cinder-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "cinder-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Acquiring lock "cinder-quobyte-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "cinder-quobyte-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e5c3fb-3550-4fbc-a1c1-a9e778620de8]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:42 devstack sudo[89832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b
Apr 16 19:54:42 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:42 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 1073741824" returned: 0 in 0.506s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:42 devstack sudo[89837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26
Apr 16 19:54:42 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:42 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b" returned: 0 in 0.516s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:42 devstack sudo[89842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b
Apr 16 19:54:42 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:42 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26" returned: 0 in 0.463s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.volume_utils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Attempting download of ab1fba02-b27f-4200-aae8-7c2e7a56bc6e ((None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}])) to volume 257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26. {{(pid=82616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d20009-e51b-4b5c-8422-7cc833ae9c46]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_2ttn807d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Flow 'volume_create_manager' (e0bc68ec-7823-4b46-a972-42ab57d6712d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126e534e-2956-4582-8eca-df9add727388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126e534e-2956-4582-8eca-df9add727388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3ce6a3-e865-4164-9e3e-54a5f6a27499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37654df8ec794ceb9aa2e8e967e073de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:43Z,use_quota=True,user_id='f4663f025d2b4f51b0548a1932319c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6abd83e-f3ee-44e1-bf05-7f91d191eba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6abd83e-f3ee-44e1-bf05-7f91d191eba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:42 devstack sudo[89845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_2ttn807d
Apr 16 19:54:42 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5fd8d7-983c-4674-8c67-d4269a378ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5fd8d7-983c-4674-8c67-d4269a378ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e3ce6a3-e865-4164-9e3e-54a5f6a27499', 'volume_name': 'volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499', 'volume_size': 1, 'snapshot_id': '2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87404af-7d59-4ea7-8c2c-0231ab494b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87404af-7d59-4ea7-8c2c-0231ab494b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc4cd16-e96f-4409-a360-06535e5c20c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:42 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Volume 9e3ce6a3-e865-4164-9e3e-54a5f6a27499: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499', 'volume_size': 1, 'snapshot_id': '2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89'}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "cinder-quobyte-2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89-9e3ce6a3-e865-4164-9e3e-54a5f6a27499" by "_create_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-quobyte-2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89-9e3ce6a3-e865-4164-9e3e-54a5f6a27499" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Creating volume 9e3ce6a3-e865-4164-9e3e-54a5f6a27499 from snapshot 2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 {{(pid=82616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "cinder-quobyte-9e3ce6a3-e865-4164-9e3e-54a5f6a27499" by "_copy_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-quobyte-9e3ce6a3-e865-4164-9e3e-54a5f6a27499" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] snapshot: 2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89, volume: 9e3ce6a3-e865-4164-9e3e-54a5f6a27499,  {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc1bf59-fb70-46a4-ba96-9af5de9ed319]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:43 devstack sudo[89847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89
Apr 16 19:54:43 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:43 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b" returned: 0 in 0.477s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "cinder-quobyte-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b" released by "delete_volume" :: held 1.038s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Created reservations ['713c187f-c5cf-433b-960c-3a06a5d31888', '5aeefa30-1828-49d2-845d-2235eadd9e0f', 'ae56994f-d518-46bf-9f29-0e1ed81c55b7', '6034e591-655d-44d3-bb31-97448f73c148'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:43 devstack sudo[89850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:43 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:43 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_2ttn807d" returned: 0 in 0.471s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_2ttn807d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:43 devstack sudo[89854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_2ttn807d
Apr 16 19:54:43 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:43 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89" returned: 0 in 0.511s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e699906d-279a-443c-9338-cda79afbba9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Creating direct copy from snapshot {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe7605e-1068-4d7b-b6ed-4545978253ec]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:43 devstack sudo[89859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b
Apr 16 19:54:43 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:43 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.418s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:43 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Deleted volume successfully.
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-92ab276d-6f54-4b6a-9e28-5d3cd7c352c3 tempest-VolumesSnapshotNegativeTestJSON-912329248 None] Lock "cinder-1f53fe33-fab7-4c13-9796-8fa9e8f5b59b-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:43 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_2ttn807d" returned: 1 in 0.504s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_2ttn807d' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[78855192-589d-4bda-98ce-89bcc150004d]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:43 devstack sudo[89864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD
Apr 16 19:54:43 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:44 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b" returned: 0 in 0.501s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:44 devstack cinder-volume[82616]: DEBUG cinder.utils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Path /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499 not found in is_blk_device check {{(pid=82616) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 19:54:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:44 devstack sudo[89869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499
Apr 16 19:54:44 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:44 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:44 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] ab1fba02-b27f-4200-aae8-7c2e7a56bc6e was qcow2, converting to raw {{(pid=82616) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 16 19:54:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:44 devstack sudo[89874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26
Apr 16 19:54:44 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:46 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26" returned: 0 in 1.947s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:46 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab1fba02-b27f-4200-aae8-7c2e7a56bc6e_huhbdlzddevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:54:46 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Converted 112.00 MB image at 57.45 MB/s
Apr 16 19:54:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:46 devstack sudo[89899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 1G
Apr 16 19:54:46 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:46 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499" returned: 0 in 2.354s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:46 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a9916a-24c0-48e0-8e90-4b8d0a4e06cc]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:46 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b
Apr 16 19:54:46 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:46 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 1G" returned: 0 in 0.475s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:46 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[19609eb0-3340-4103-8771-262190e42d0d]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:46 devstack sudo[89906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26
Apr 16 19:54:46 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:46 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b" returned: 0 in 0.632s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b, size 1024.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:54:47 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Converted 1024.00 MB image at 434.79 MB/s
Apr 16 19:54:47 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499 is being set with open permissions: ugo+rw
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:47 devstack sudo[89911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499
Apr 16 19:54:47 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:47 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26" returned: 0 in 0.493s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:47 devstack sudo[89915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26
Apr 16 19:54:47 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:47 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499" returned: 0 in 0.426s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-quobyte-9e3ce6a3-e865-4164-9e3e-54a5f6a27499" released by "_copy_volume_from_snapshot" :: held 4.479s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-quobyte-2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89-9e3ce6a3-e865-4164-9e3e-54a5f6a27499" released by "_create_volume_from_snapshot" :: held 4.498s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.508s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc4cd16-e96f-4409-a360-06535e5c20c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499', 'volume_size': 1, 'snapshot_id': '2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb19d3f9-e2ec-438c-9158-8db7a1000bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:47 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Volume volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499 (9e3ce6a3-e865-4164-9e3e-54a5f6a27499): created successfully
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb19d3f9-e2ec-438c-9158-8db7a1000bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Flow 'volume_create_manager' (e0bc68ec-7823-4b46-a972-42ab57d6712d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:47 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-9a4c2db5-ed1a-4b04-9179-cf0353bf626f tempest-SnapshotDependencyTests-703089766 None] Created volume successfully.
Apr 16 19:54:47 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26" returned: 1 in 0.490s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.volume.volume_utils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Downloaded image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e ((None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}])) to volume 257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 successfully. {{(pid=82616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Temporary image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e for user ac26e0e4377f4e5b9cd5d49c73724838 is deleted. {{(pid=82616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.volume.volume_utils [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Marking volume 257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 as bootable. {{(pid=82616) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Copying metadata from image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e to 257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26. {{(pid=82616) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Creating volume glance metadata for volume 257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 backed by image ab1fba02-b27f-4200-aae8-7c2e7a56bc6e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82616) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ac8645-a3b0-48cb-a6cc-2330d4cda11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26', 'volume_size': 1, 'image_id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94595a210065472391c483fcf54511ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab1fba02-b27f-4200-aae8-7c2e7a56bc6e', 'created_at': datetime.datetime(2026, 4, 16, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab1fba02-b27f-4200-aae8-7c2e7a56bc6e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa362a0a560>}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91dd063-4035-403a-982c-a55f2302b476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:47 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Volume volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 (257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26): created successfully
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91dd063-4035-403a-982c-a55f2302b476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Flow 'volume_create_manager' (a043a9bb-38fa-41b8-958f-e1e96330cdb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:47 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-d611358e-50d2-48c4-9df0-638f3013390b tempest-VolumesExtendTest-3929035 None] Created volume successfully.
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3e211d63-297a-4121-b65f-68df9464e9f4 tempest-VolumesExtendTest-3929035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3e211d63-297a-4121-b65f-68df9464e9f4 tempest-VolumesExtendTest-3929035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1419f9c-2c8d-4be5-b5bb-45ed03b19666]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3e211d63-297a-4121-b65f-68df9464e9f4 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:48 devstack sudo[89921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26
Apr 16 19:54:48 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "cinder-2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "cinder-quobyte-e699906d-279a-443c-9338-cda79afbba9b" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-quobyte-e699906d-279a-443c-9338-cda79afbba9b" acquired by "delete_snapshot" :: waited 0.005s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "cinder-quobyte-2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-quobyte-2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Deleting offline snapshot 2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 of volume e699906d-279a-443c-9338-cda79afbba9b {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] snapshot_file for this snap is: volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc93d20-77ed-4c5b-bb0c-f6f15b10ccde]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:48 devstack sudo[89923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89
Apr 16 19:54:48 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:48 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3e211d63-297a-4121-b65f-68df9464e9f4 tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26" returned: 0 in 0.501s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3e211d63-297a-4121-b65f-68df9464e9f4 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:48 devstack sudo[89927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26
Apr 16 19:54:48 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:48 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89" returned: 0 in 0.496s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e699906d-279a-443c-9338-cda79afbba9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[25352c44-7a39-4548-aa9f-231b329ba486]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:48 devstack sudo[89932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b
Apr 16 19:54:48 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:48 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3e211d63-297a-4121-b65f-68df9464e9f4 tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26" returned: 1 in 0.501s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3e211d63-297a-4121-b65f-68df9464e9f4 tempest-VolumesExtendTest-3929035 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:54:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3e211d63-297a-4121-b65f-68df9464e9f4 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 2G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3e211d63-297a-4121-b65f-68df9464e9f4 tempest-VolumesExtendTest-3929035 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 2G" returned: 0 in 0.046s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3e211d63-297a-4121-b65f-68df9464e9f4 tempest-VolumesExtendTest-3929035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.080s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:49 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-3e211d63-297a-4121-b65f-68df9464e9f4 tempest-VolumesExtendTest-3929035 None] Extend volume completed successfully.
Apr 16 19:54:49 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b" returned: 0 in 0.484s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:49 devstack sudo[89943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89
Apr 16 19:54:49 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:49 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89" returned: 0 in 0.448s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:49 devstack sudo[89948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89
Apr 16 19:54:49 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:50 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b.2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89" returned: 0 in 0.417s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-quobyte-2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89" released by "_delete_snapshot" :: held 1.896s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-quobyte-e699906d-279a-443c-9338-cda79afbba9b" released by "delete_snapshot" :: held 1.911s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Acquiring lock "cinder-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Lock "cinder-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Created reservations ['de9122d9-a5c5-42b3-8815-25c49cea7cd7', '226c29fe-c657-4d23-81b9-263711d547e5', '15b1cb0f-ab1a-4698-98f0-7dea074a4d10', '7937000e-1dbf-4219-93f5-1aadc2c5bcb9'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Acquiring lock "cinder-quobyte-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Lock "cinder-quobyte-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26" acquired by "delete_volume" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:50 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Delete snapshot completed successfully.
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eda87c61-e514-4802-ba21-a0006419761a tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-2e9e52a0-e0f2-4c54-8cf3-0f8ed19e2c89-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0578d3a6-720d-4c91-b00e-57365114813d]: (4, 'raw') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "cinder-e699906d-279a-443c-9338-cda79afbba9b-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:50 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26
Apr 16 19:54:50 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-e699906d-279a-443c-9338-cda79afbba9b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "cinder-quobyte-e699906d-279a-443c-9338-cda79afbba9b" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-quobyte-e699906d-279a-443c-9338-cda79afbba9b" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a7ce5d-bf7d-4659-a422-f094f28cdba3]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:50 devstack sudo[89953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b
Apr 16 19:54:50 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:50 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26" returned: 0 in 0.493s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:50 devstack sudo[89957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26
Apr 16 19:54:50 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:50 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b" returned: 0 in 0.477s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:50 devstack sudo[89962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b
Apr 16 19:54:50 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:51 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26" returned: 1 in 0.470s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26' failed. Not Retrying. {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:51 devstack sudo[89968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26
Apr 16 19:54:51 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:51 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-e699906d-279a-443c-9338-cda79afbba9b" returned: 0 in 0.415s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-quobyte-e699906d-279a-443c-9338-cda79afbba9b" released by "delete_volume" :: held 0.921s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Created reservations ['693306ea-2c46-4512-9b94-d561f75eb745', 'bd370be5-09b8-4af6-913a-27cd3dc2cd3e', 'ed4a22fd-8814-45a4-b5bf-8b7cf8f2745f', 'e89fd905-951a-49c4-b4d6-09af28cfb112'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:51 devstack sudo[89970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:51 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "cinder-9e3ce6a3-e865-4164-9e3e-54a5f6a27499-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-9e3ce6a3-e865-4164-9e3e-54a5f6a27499-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "cinder-quobyte-9e3ce6a3-e865-4164-9e3e-54a5f6a27499" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-quobyte-9e3ce6a3-e865-4164-9e3e-54a5f6a27499" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[884e89de-fd1e-486b-bc4e-ab7753a1e6da]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:51 devstack sudo[89972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499
Apr 16 19:54:51 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:51 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26" returned: 0 in 0.454s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Lock "cinder-quobyte-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26" released by "delete_volume" :: held 1.458s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Created reservations ['f87eb17e-6497-4107-b488-436de8e92093', 'c4c60b07-e23f-4783-8dcb-2706635c696c', '0c035e5c-ed35-4d6c-8626-b416257e0951', 'f27d2e50-d7bc-4f50-bc1f-f39881e96e12'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:51 devstack sudo[89976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:51 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:51 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.445s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:51 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Deleted volume successfully.
Apr 16 19:54:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5b7e698e-2820-4349-818e-2798d8b84b43 tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-e699906d-279a-443c-9338-cda79afbba9b-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:52 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499" returned: 0 in 0.502s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:52 devstack sudo[89981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499
Apr 16 19:54:52 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:52 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.419s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:52 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Deleted volume successfully.
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d4de7a4b-68d1-426a-bce9-bdea476c0438 tempest-VolumesExtendTest-3929035 None] Lock "cinder-257f7ae4-6f2d-4c85-9a6d-e50c50bd8c26-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:52 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9e3ce6a3-e865-4164-9e3e-54a5f6a27499" returned: 0 in 0.427s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-quobyte-9e3ce6a3-e865-4164-9e3e-54a5f6a27499" released by "delete_volume" :: held 0.955s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Created reservations ['ad8a1fda-bb3b-43d0-a799-2515e536f18b', '43f5aa9f-32f0-42e7-a921-5bc681237fc3', '0101cb79-d371-4e26-96a8-4acfbccb778b', 'f24aeae8-2f36-46c4-8cee-517330284899'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:54:52 devstack sudo[89985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:54:52 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Flow 'volume_create_manager' (4232ca1e-5873-4098-9dc6-6f0685e26dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83151ea9-78f2-4da4-9817-1109be56da12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83151ea9-78f2-4da4-9817-1109be56da12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1333582691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab5385f-e917-4e28-a118-926b1dfb67b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f64dd452a941449bdae141c24afd8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:53Z,use_quota=True,user_id='ac26e0e4377f4e5b9cd5d49c73724838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8857b445-ac26-4aa4-8ff0-c158455f6e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8857b445-ac26-4aa4-8ff0-c158455f6e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277ae0cd-1fb2-45d2-b71d-e4155f250069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277ae0cd-1fb2-45d2-b71d-e4155f250069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab5385f-e917-4e28-a118-926b1dfb67b8', 'volume_name': 'volume-9ab5385f-e917-4e28-a118-926b1dfb67b8', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16504b1-62df-4b8d-91e6-fd6f59ebd859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16504b1-62df-4b8d-91e6-fd6f59ebd859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66434d26-5fea-4a0b-984a-f1c1f706331c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:52 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Volume 9ab5385f-e917-4e28-a118-926b1dfb67b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab5385f-e917-4e28-a118-926b1dfb67b8', 'volume_size': 1}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1333582691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab5385f-e917-4e28-a118-926b1dfb67b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f64dd452a941449bdae141c24afd8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:54:53Z,use_quota=True,user_id='ac26e0e4377f4e5b9cd5d49c73724838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Creating volume 9ab5385f-e917-4e28-a118-926b1dfb67b8 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:54:52 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:54:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:52 devstack sudo[89987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8 1073741824
Apr 16 19:54:52 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:53 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.450s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:53 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:54:53 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Deleted volume successfully.
Apr 16 19:54:53 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5826ffd5-3b7f-40a5-9060-c09a99824658 tempest-SnapshotDependencyTests-703089766 None] Lock "cinder-9e3ce6a3-e865-4164-9e3e-54a5f6a27499-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:54:53 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8 1073741824" returned: 0 in 0.554s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:53 devstack sudo[89993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8
Apr 16 19:54:53 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:53 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8" returned: 0 in 0.441s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:54:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66434d26-5fea-4a0b-984a-f1c1f706331c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab5385f-e917-4e28-a118-926b1dfb67b8', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100f3dbd-8317-4f94-914c-3c686606e03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:54:53 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Volume volume-9ab5385f-e917-4e28-a118-926b1dfb67b8 (9ab5385f-e917-4e28-a118-926b1dfb67b8): created successfully
Apr 16 19:54:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100f3dbd-8317-4f94-914c-3c686606e03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:54:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Flow 'volume_create_manager' (4232ca1e-5873-4098-9dc6-6f0685e26dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:54:53 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ac808e8f-29d0-461a-8a6a-540f9cdda24f tempest-VolumesExtendTest-3929035 None] Created volume successfully.
Apr 16 19:54:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:54 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] Creating offline snapshot d1d98a35-8df7-4dbd-8356-c60775f3cd79 of volume 9ab5385f-e917-4e28-a118-926b1dfb67b8 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:54:54 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f829f66-8575-412d-afa4-cbdf3a0ce6e7]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:55 devstack sudo[89998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8
Apr 16 19:54:55 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:55 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8" returned: 0 in 0.525s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:55 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79 1G
Apr 16 19:54:55 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:55 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79 1G" returned: 0 in 0.513s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab5385f-e917-4e28-a118-926b1dfb67b8 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:56 devstack sudo[90009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab5385f-e917-4e28-a118-926b1dfb67b8 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79
Apr 16 19:54:56 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:56 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab5385f-e917-4e28-a118-926b1dfb67b8 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79" returned: 0 in 0.478s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:56 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79 is being set with open permissions: ugo+rw
Apr 16 19:54:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:56 devstack sudo[90015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79
Apr 16 19:54:56 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:56 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79" returned: 0 in 0.438s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:56 devstack sudo[90018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.info
Apr 16 19:54:56 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:57 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.info" returned: 0 in 0.484s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:57 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.info is being set with open permissions: ugo+rw
Apr 16 19:54:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:57 devstack sudo[90021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.info
Apr 16 19:54:57 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:57 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.info" returned: 0 in 0.486s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.979s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:57 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f5a54efd-d5a6-4fa2-9d32-f3954004d190 tempest-VolumesExtendTest-3929035 None] Create snapshot completed successfully
Apr 16 19:54:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7513e2d9-4bd3-4460-945e-71d75acacc26 tempest-VolumesExtendTest-3929035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:54:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7513e2d9-4bd3-4460-945e-71d75acacc26 tempest-VolumesExtendTest-3929035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:54:58 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3217b7e-372e-4876-af90-c9a1f08a8cd7]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7513e2d9-4bd3-4460-945e-71d75acacc26 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:58 devstack sudo[90025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8
Apr 16 19:54:58 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:58 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7513e2d9-4bd3-4460-945e-71d75acacc26 tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8" returned: 0 in 0.518s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7513e2d9-4bd3-4460-945e-71d75acacc26 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79 2G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7513e2d9-4bd3-4460-945e-71d75acacc26 tempest-VolumesExtendTest-3929035 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79 2G" returned: 0 in 0.068s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7513e2d9-4bd3-4460-945e-71d75acacc26 tempest-VolumesExtendTest-3929035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.603s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:54:58 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7513e2d9-4bd3-4460-945e-71d75acacc26 tempest-VolumesExtendTest-3929035 None] Extend volume completed successfully.
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Acquiring lock "cinder-d1d98a35-8df7-4dbd-8356-c60775f3cd79-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Lock "cinder-d1d98a35-8df7-4dbd-8356-c60775f3cd79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Acquiring lock "cinder-quobyte-9ab5385f-e917-4e28-a118-926b1dfb67b8" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Lock "cinder-quobyte-9ab5385f-e917-4e28-a118-926b1dfb67b8" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Acquiring lock "cinder-quobyte-d1d98a35-8df7-4dbd-8356-c60775f3cd79" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Lock "cinder-quobyte-d1d98a35-8df7-4dbd-8356-c60775f3cd79" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Deleting offline snapshot d1d98a35-8df7-4dbd-8356-c60775f3cd79 of volume 9ab5385f-e917-4e28-a118-926b1dfb67b8 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] snapshot_file for this snap is: volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0a92c5-e247-4fb0-a92f-3b1daeef634f]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:59 devstack sudo[90033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79
Apr 16 19:54:59 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:54:59 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79" returned: 0 in 0.460s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ab5385f-e917-4e28-a118-926b1dfb67b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a899200-8ea7-4c30-87f8-91033c525728]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:54:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:54:59 devstack sudo[90038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8
Apr 16 19:54:59 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:00 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8" returned: 0 in 0.458s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:00 devstack sudo[90043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79
Apr 16 19:55:00 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:00 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79" returned: 0 in 0.459s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:00 devstack sudo[90048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79
Apr 16 19:55:00 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:01 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8.d1d98a35-8df7-4dbd-8356-c60775f3cd79" returned: 0 in 0.401s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Lock "cinder-quobyte-d1d98a35-8df7-4dbd-8356-c60775f3cd79" released by "_delete_snapshot" :: held 1.833s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Lock "cinder-quobyte-9ab5385f-e917-4e28-a118-926b1dfb67b8" released by "delete_snapshot" :: held 1.849s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:01 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Created reservations ['b78a21a9-6059-42af-98b2-a9213a2cdb8d', 'a19bfa60-e63c-4469-b259-60df6eb10b1a', '232a09af-1cc5-4e13-8e80-22ffd83924f8', '4b7e1d9d-d885-472f-9e4a-427cee9f7e7a'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:01 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Delete snapshot completed successfully.
Apr 16 19:55:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76369002-0424-4b51-8aad-2dd98660d957 tempest-VolumesExtendTest-3929035 None] Lock "cinder-d1d98a35-8df7-4dbd-8356-c60775f3cd79-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Acquiring lock "cinder-9ab5385f-e917-4e28-a118-926b1dfb67b8-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Lock "cinder-9ab5385f-e917-4e28-a118-926b1dfb67b8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Acquiring lock "cinder-quobyte-9ab5385f-e917-4e28-a118-926b1dfb67b8" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Lock "cinder-quobyte-9ab5385f-e917-4e28-a118-926b1dfb67b8" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:01 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5bde33-21b2-459a-8c9e-15b42b86845b]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:01 devstack sudo[90051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8
Apr 16 19:55:01 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:01 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8" returned: 0 in 0.462s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:01 devstack sudo[90056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8
Apr 16 19:55:01 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:02 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9ab5385f-e917-4e28-a118-926b1dfb67b8" returned: 0 in 0.436s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Lock "cinder-quobyte-9ab5385f-e917-4e28-a118-926b1dfb67b8" released by "delete_volume" :: held 0.933s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:02 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Created reservations ['d5f69877-5406-4bee-ac1d-75a93868e01e', '45cb83c6-78d0-4d52-a468-a6276701c43e', '207afe73-1e30-4776-98a8-3dfed06f6016', 'dd058522-b7e7-4f39-9341-d2083a6e6d09'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:02 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:02 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:02 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.473s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:02 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:02 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Deleted volume successfully.
Apr 16 19:55:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-2fa906e2-0e51-459c-b6cc-3ce8e7ed1561 tempest-VolumesExtendTest-3929035 None] Lock "cinder-9ab5385f-e917-4e28-a118-926b1dfb67b8-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Flow 'volume_create_manager' (efce5448-1d20-40e6-8165-688db2c2e846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488a06e6-010c-4da5-b929-a5222f60db0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488a06e6-010c-4da5-b929-a5222f60db0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1800401330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d2f913-32c2-4f39-a621-d86b49e68750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbd08918d994c7e899ea37b5bc1cb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:04Z,use_quota=True,user_id='62e6ab33c9cd4025b967f089706fda49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970b75d3-8267-4386-8371-c4e7593a63ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970b75d3-8267-4386-8371-c4e7593a63ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cd0655-b849-4d60-b9e1-17d8e31816e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cd0655-b849-4d60-b9e1-17d8e31816e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62d2f913-32c2-4f39-a621-d86b49e68750', 'volume_name': 'volume-62d2f913-32c2-4f39-a621-d86b49e68750', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319e61e8-6a77-4896-8db9-aeb6c5e7d2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319e61e8-6a77-4896-8db9-aeb6c5e7d2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49e5be3-3038-4da0-b12d-519c4e020efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Volume 62d2f913-32c2-4f39-a621-d86b49e68750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62d2f913-32c2-4f39-a621-d86b49e68750', 'volume_size': 1}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1800401330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d2f913-32c2-4f39-a621-d86b49e68750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbd08918d994c7e899ea37b5bc1cb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:04Z,use_quota=True,user_id='62e6ab33c9cd4025b967f089706fda49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Creating volume 62d2f913-32c2-4f39-a621-d86b49e68750 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:04 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-62d2f913-32c2-4f39-a621-d86b49e68750 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:04 devstack sudo[90237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-62d2f913-32c2-4f39-a621-d86b49e68750 1073741824
Apr 16 19:55:04 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Flow 'volume_create_manager' (ea9be18c-89d1-4343-a844-68ec688ee92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ffd19e-8773-4c59-bfac-d860842e0253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ffd19e-8773-4c59-bfac-d860842e0253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-428329399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e4ae4d-9341-47ab-b0f9-e967e0f81b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbd08918d994c7e899ea37b5bc1cb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:04Z,use_quota=True,user_id='62e6ab33c9cd4025b967f089706fda49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d7636d-0514-4f09-b0be-89e652f4a1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d7636d-0514-4f09-b0be-89e652f4a1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf541e0e-05ad-49c5-8401-86d51f57f757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf541e0e-05ad-49c5-8401-86d51f57f757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e4ae4d-9341-47ab-b0f9-e967e0f81b33', 'volume_name': 'volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db1badd-0dff-4efa-99b3-e7e4bafc2f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db1badd-0dff-4efa-99b3-e7e4bafc2f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4873970d-4f5d-4062-af17-089b3c156d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Volume 34e4ae4d-9341-47ab-b0f9-e967e0f81b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33', 'volume_size': 1}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Flow 'volume_create_manager' (9c028133-9bdc-4632-8f03-6f3b4bc06c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d3479a-5a91-4de1-ac15-e24a181249cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d3479a-5a91-4de1-ac15-e24a181249cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-174688914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70fdd38-fcd3-47b7-a9e7-c6090ffca44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbd08918d994c7e899ea37b5bc1cb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:05Z,use_quota=True,user_id='62e6ab33c9cd4025b967f089706fda49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98a5bc4-7430-40af-934a-b816ac721010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98a5bc4-7430-40af-934a-b816ac721010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ffc0d30-5055-4fd5-a20e-ae9915256ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ffc0d30-5055-4fd5-a20e-ae9915256ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70fdd38-fcd3-47b7-a9e7-c6090ffca44a', 'volume_name': 'volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbd7e9c-ac34-4843-8060-97e9c06dfb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbd7e9c-ac34-4843-8060-97e9c06dfb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671f07e7-5dd7-48c6-bcfb-866b4dc21332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Volume f70fdd38-fcd3-47b7-a9e7-c6090ffca44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a', 'volume_size': 1}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:04 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-62d2f913-32c2-4f39-a621-d86b49e68750 1073741824" returned: 0 in 0.542s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-62d2f913-32c2-4f39-a621-d86b49e68750 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:04 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-62d2f913-32c2-4f39-a621-d86b49e68750
Apr 16 19:55:04 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Flow 'volume_create_manager' (c38fb028-fbea-40e2-a316-86800b12d4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06326033-3623-4027-9b61-b8b53823cfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06326033-3623-4027-9b61-b8b53823cfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-632490449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f17808a-e7f1-407a-9030-d9eb4c36ea45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbd08918d994c7e899ea37b5bc1cb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:05Z,use_quota=True,user_id='62e6ab33c9cd4025b967f089706fda49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de41232e-d76d-4c43-aecb-77b3bb1aa07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de41232e-d76d-4c43-aecb-77b3bb1aa07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb50425d-f88f-47a5-bb9e-8ff190be804a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb50425d-f88f-47a5-bb9e-8ff190be804a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f17808a-e7f1-407a-9030-d9eb4c36ea45', 'volume_name': 'volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a349a63e-fb98-40d9-a944-3851b0ceceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a349a63e-fb98-40d9-a944-3851b0ceceb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9013a7f0-1766-4312-911d-4a68065ee3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Volume 8f17808a-e7f1-407a-9030-d9eb4c36ea45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45', 'volume_size': 1}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Flow 'volume_create_manager' (e1d804cc-889f-440d-ad62-938200ea9461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091ba94f-30cf-4fe7-8dd4-d06cdf32b805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:04 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091ba94f-30cf-4fe7-8dd4-d06cdf32b805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-341457881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf8a7b5-edf1-4390-9937-492caa96b44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbd08918d994c7e899ea37b5bc1cb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:05Z,use_quota=True,user_id='62e6ab33c9cd4025b967f089706fda49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b26333d-f298-4ff9-bb2c-11edc039ff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b26333d-f298-4ff9-bb2c-11edc039ff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c69f48-a3ec-4a97-a54e-c8b756d737bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c69f48-a3ec-4a97-a54e-c8b756d737bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf8a7b5-edf1-4390-9937-492caa96b44b', 'volume_name': 'volume-caf8a7b5-edf1-4390-9937-492caa96b44b', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a572d4a-5505-42ea-bff5-e857d7c3415e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a572d4a-5505-42ea-bff5-e857d7c3415e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7419225d-e746-4213-b0bc-93b075c504dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:05 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Volume caf8a7b5-edf1-4390-9937-492caa96b44b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf8a7b5-edf1-4390-9937-492caa96b44b', 'volume_size': 1}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:05 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-62d2f913-32c2-4f39-a621-d86b49e68750" returned: 0 in 0.451s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-428329399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e4ae4d-9341-47ab-b0f9-e967e0f81b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbd08918d994c7e899ea37b5bc1cb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:04Z,use_quota=True,user_id='62e6ab33c9cd4025b967f089706fda49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Creating volume 34e4ae4d-9341-47ab-b0f9-e967e0f81b33 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:05 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49e5be3-3038-4da0-b12d-519c4e020efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62d2f913-32c2-4f39-a621-d86b49e68750', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6325d1d-4204-4dad-a470-49a7c55bd71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:05 devstack sudo[90246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33 1073741824
Apr 16 19:55:05 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:05 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Volume volume-62d2f913-32c2-4f39-a621-d86b49e68750 (62d2f913-32c2-4f39-a621-d86b49e68750): created successfully
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6325d1d-4204-4dad-a470-49a7c55bd71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Flow 'volume_create_manager' (efce5448-1d20-40e6-8165-688db2c2e846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:05 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f7422463-ff68-4877-8662-7b87bc619359 tempest-CreateVolumesFromImageTest-1605524943 None] Created volume successfully.
Apr 16 19:55:05 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33 1073741824" returned: 0 in 0.463s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:05 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33
Apr 16 19:55:05 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:06 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33" returned: 0 in 0.437s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-174688914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70fdd38-fcd3-47b7-a9e7-c6090ffca44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbd08918d994c7e899ea37b5bc1cb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:05Z,use_quota=True,user_id='62e6ab33c9cd4025b967f089706fda49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Creating volume f70fdd38-fcd3-47b7-a9e7-c6090ffca44a {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:06 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4873970d-4f5d-4062-af17-089b3c156d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:06 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a 1073741824
Apr 16 19:55:06 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2481af72-f25d-4322-833a-36ef0800bf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:06 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Volume volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33 (34e4ae4d-9341-47ab-b0f9-e967e0f81b33): created successfully
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2481af72-f25d-4322-833a-36ef0800bf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Flow 'volume_create_manager' (ea9be18c-89d1-4343-a844-68ec688ee92d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:06 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-4db5bb3f-c07c-4c34-bf25-29c7192224c9 tempest-CreateVolumesFromImageTest-1605524943 None] Created volume successfully.
Apr 16 19:55:06 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a 1073741824" returned: 0 in 0.482s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:06 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a
Apr 16 19:55:06 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:07 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a" returned: 0 in 0.421s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-632490449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f17808a-e7f1-407a-9030-d9eb4c36ea45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbd08918d994c7e899ea37b5bc1cb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:05Z,use_quota=True,user_id='62e6ab33c9cd4025b967f089706fda49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Creating volume 8f17808a-e7f1-407a-9030-d9eb4c36ea45 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:07 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671f07e7-5dd7-48c6-bcfb-866b4dc21332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c710145-252c-42a5-bb11-7c86e6812439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:07 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45 1073741824
Apr 16 19:55:07 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:07 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Volume volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a (f70fdd38-fcd3-47b7-a9e7-c6090ffca44a): created successfully
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c710145-252c-42a5-bb11-7c86e6812439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Flow 'volume_create_manager' (9c028133-9bdc-4632-8f03-6f3b4bc06c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:07 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-15742c47-309c-4f90-a143-815af237ec3e tempest-CreateVolumesFromImageTest-1605524943 None] Created volume successfully.
Apr 16 19:55:07 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45 1073741824" returned: 0 in 0.516s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:07 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45
Apr 16 19:55:07 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:08 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45" returned: 0 in 0.421s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.074s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-341457881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf8a7b5-edf1-4390-9937-492caa96b44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbd08918d994c7e899ea37b5bc1cb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:05Z,use_quota=True,user_id='62e6ab33c9cd4025b967f089706fda49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Creating volume caf8a7b5-edf1-4390-9937-492caa96b44b {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:08 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-caf8a7b5-edf1-4390-9937-492caa96b44b 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9013a7f0-1766-4312-911d-4a68065ee3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:08 devstack sudo[90272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-caf8a7b5-edf1-4390-9937-492caa96b44b 1073741824
Apr 16 19:55:08 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21683c3b-8760-4af9-9fb3-ca90508b124a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:08 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Volume volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45 (8f17808a-e7f1-407a-9030-d9eb4c36ea45): created successfully
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21683c3b-8760-4af9-9fb3-ca90508b124a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Flow 'volume_create_manager' (c38fb028-fbea-40e2-a316-86800b12d4c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:08 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c16c480e-5500-4fba-9759-a49fa5616f57 tempest-CreateVolumesFromImageTest-1605524943 None] Created volume successfully.
Apr 16 19:55:08 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-caf8a7b5-edf1-4390-9937-492caa96b44b 1073741824" returned: 0 in 0.506s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-caf8a7b5-edf1-4390-9937-492caa96b44b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:08 devstack sudo[90277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-caf8a7b5-edf1-4390-9937-492caa96b44b
Apr 16 19:55:08 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:09 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-caf8a7b5-edf1-4390-9937-492caa96b44b" returned: 0 in 0.405s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7419225d-e746-4213-b0bc-93b075c504dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf8a7b5-edf1-4390-9937-492caa96b44b', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863cfd78-6f4f-4a13-8f8c-04c7b5b93758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:09 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Volume volume-caf8a7b5-edf1-4390-9937-492caa96b44b (caf8a7b5-edf1-4390-9937-492caa96b44b): created successfully
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863cfd78-6f4f-4a13-8f8c-04c7b5b93758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Flow 'volume_create_manager' (e1d804cc-889f-440d-ad62-938200ea9461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:09 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7eb97b24-3a37-49b8-8e3e-741d26a8e69a tempest-CreateVolumesFromImageTest-1605524943 None] Created volume successfully.
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "cinder-caf8a7b5-edf1-4390-9937-492caa96b44b-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-caf8a7b5-edf1-4390-9937-492caa96b44b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "cinder-quobyte-caf8a7b5-edf1-4390-9937-492caa96b44b" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-quobyte-caf8a7b5-edf1-4390-9937-492caa96b44b" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d07679-4b49-4102-8a7b-e8b438eaa476]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-caf8a7b5-edf1-4390-9937-492caa96b44b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:09 devstack sudo[90280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-caf8a7b5-edf1-4390-9937-492caa96b44b
Apr 16 19:55:09 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:09 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-caf8a7b5-edf1-4390-9937-492caa96b44b" returned: 0 in 0.494s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-caf8a7b5-edf1-4390-9937-492caa96b44b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:09 devstack sudo[90285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-caf8a7b5-edf1-4390-9937-492caa96b44b
Apr 16 19:55:09 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:10 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-caf8a7b5-edf1-4390-9937-492caa96b44b" returned: 0 in 0.418s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-quobyte-caf8a7b5-edf1-4390-9937-492caa96b44b" released by "delete_volume" :: held 0.934s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Created reservations ['766e383c-04b4-40e4-92b1-c0a65be9cf8f', 'b8db136c-ddfe-4ec3-81c1-647ac8adb819', '3c60c6cf-91e5-4988-baa7-ae8774347956', 'c859a424-d6d8-448b-a981-62334090c9c3'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:10 devstack sudo[90288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:10 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "cinder-8f17808a-e7f1-407a-9030-d9eb4c36ea45-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-8f17808a-e7f1-407a-9030-d9eb4c36ea45-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "cinder-quobyte-8f17808a-e7f1-407a-9030-d9eb4c36ea45" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-quobyte-8f17808a-e7f1-407a-9030-d9eb4c36ea45" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ed2f48-0749-433b-862d-49a6641bfefe]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:10 devstack sudo[90290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45
Apr 16 19:55:10 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:10 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.465s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:10 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Deleted volume successfully.
Apr 16 19:55:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-01e86c08-b7e4-4292-b480-a3f275cf0fdd tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-caf8a7b5-edf1-4390-9937-492caa96b44b-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:11 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45" returned: 0 in 0.481s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:11 devstack sudo[90296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45
Apr 16 19:55:11 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:11 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-8f17808a-e7f1-407a-9030-d9eb4c36ea45" returned: 0 in 0.433s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-quobyte-8f17808a-e7f1-407a-9030-d9eb4c36ea45" released by "delete_volume" :: held 0.940s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Created reservations ['720369d5-bf9e-4cb3-82a0-ff7cbbe8370b', '0077b10e-4ed8-403e-897a-e30ffe1a4352', 'd368b1f3-d0c9-43de-8de9-190c8b6c586c', '51c8f36e-9804-48f4-aeea-505bd06cff83'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_service.periodic_task [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82616) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:11 devstack sudo[90299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:11 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:11 devstack sudo[90301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:11 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "cinder-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "cinder-quobyte-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-quobyte-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25642a6-6eb3-4d48-9cd6-0fcffedd3fa5]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:11 devstack sudo[90303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a
Apr 16 19:55:11 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:11 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.454s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:11 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:12 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.459s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:12 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Deleted volume successfully.
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d9fc5985-6b2b-462e-8b24-b4807fc064f7 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-8f17808a-e7f1-407a-9030-d9eb4c36ea45-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:12 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a" returned: 0 in 0.510s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:12 devstack sudo[90310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a
Apr 16 19:55:12 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:12 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a" returned: 0 in 0.430s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-quobyte-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a" released by "delete_volume" :: held 0.962s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Created reservations ['ac88d44b-54df-40f1-8f20-0b69363862ca', '774e03f7-0c02-43b6-a73a-3153806953af', 'e3a41d17-733a-4927-9b53-5c1b343c4ea4', '9c488dac-a958-41af-a8dc-50aed16b9608'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:12 devstack sudo[90313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:12 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "cinder-34e4ae4d-9341-47ab-b0f9-e967e0f81b33-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-34e4ae4d-9341-47ab-b0f9-e967e0f81b33-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "cinder-quobyte-34e4ae4d-9341-47ab-b0f9-e967e0f81b33" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-quobyte-34e4ae4d-9341-47ab-b0f9-e967e0f81b33" acquired by "delete_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[706bd887-02a3-4807-9007-77a522b67f16]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:12 devstack sudo[90315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33
Apr 16 19:55:12 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:13 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.453s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:13 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Deleted volume successfully.
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ef942c5c-ae5f-4ec7-9393-b4b77fe08088 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-f70fdd38-fcd3-47b7-a9e7-c6090ffca44a-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:13 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33" returned: 0 in 0.483s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:13 devstack sudo[90321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33
Apr 16 19:55:13 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:13 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-34e4ae4d-9341-47ab-b0f9-e967e0f81b33" returned: 0 in 0.436s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-quobyte-34e4ae4d-9341-47ab-b0f9-e967e0f81b33" released by "delete_volume" :: held 0.940s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Created reservations ['f75b7b12-19ac-430d-8b78-0421a290b9a7', '4a5e9791-1751-4ea2-a5be-c1c24e97281a', '9f4952bc-e1f0-486f-882d-a5ce538f209f', '22f402d5-97c3-4e1a-8e83-59af165bfd53'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:13 devstack sudo[90324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:13 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "cinder-62d2f913-32c2-4f39-a621-d86b49e68750-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-62d2f913-32c2-4f39-a621-d86b49e68750-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "cinder-quobyte-62d2f913-32c2-4f39-a621-d86b49e68750" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-quobyte-62d2f913-32c2-4f39-a621-d86b49e68750" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[572318e2-6b67-44b5-9eae-afbe0e6f303e]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-62d2f913-32c2-4f39-a621-d86b49e68750 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:14 devstack sudo[90326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-62d2f913-32c2-4f39-a621-d86b49e68750
Apr 16 19:55:14 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:14 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.463s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:14 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Deleted volume successfully.
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d869c52c-592e-48d3-a722-ee0e773a1ecc tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-34e4ae4d-9341-47ab-b0f9-e967e0f81b33-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:14 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-62d2f913-32c2-4f39-a621-d86b49e68750" returned: 0 in 0.496s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-62d2f913-32c2-4f39-a621-d86b49e68750 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:14 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-62d2f913-32c2-4f39-a621-d86b49e68750
Apr 16 19:55:14 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:14 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-62d2f913-32c2-4f39-a621-d86b49e68750" returned: 0 in 0.447s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-quobyte-62d2f913-32c2-4f39-a621-d86b49e68750" released by "delete_volume" :: held 0.966s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Created reservations ['86af7b66-c0d8-4107-8ab2-c886c0e0aea6', 'fc95af68-0d92-461e-8c43-bfcc0713131a', '6791824c-fb5d-468d-bf62-67f9e0fc900c', 'f39c87b6-9ba7-4edd-9809-dfb4b511bcb0'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:15 devstack sudo[90336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:15 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:15 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.469s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:15 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:15 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Deleted volume successfully.
Apr 16 19:55:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-eb26dc34-4411-4cb8-ae25-c6fe335d44c6 tempest-CreateVolumesFromImageTest-1605524943 None] Lock "cinder-62d2f913-32c2-4f39-a621-d86b49e68750-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:16 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Flow 'volume_create_manager' (1e77d8a4-985b-45fa-ad24-c7776cebe5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e518c916-86c5-4a98-95c5-025a21c44d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e518c916-86c5-4a98-95c5-025a21c44d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1506534929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef40e13-e969-4805-a6d6-7ce65d372db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea405c452f04df18b06fe699802e0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:17Z,use_quota=True,user_id='2c422637ae5944f29e1f0dc19d48233e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b21e6a-0cb1-4d36-89ca-5e34b5df1981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b21e6a-0cb1-4d36-89ca-5e34b5df1981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3adf0d3-ff21-412d-b473-c8f072aeb3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3adf0d3-ff21-412d-b473-c8f072aeb3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef40e13-e969-4805-a6d6-7ce65d372db7', 'volume_name': 'volume-6ef40e13-e969-4805-a6d6-7ce65d372db7', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee1659b-e8cf-4959-b19b-03aef927af57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee1659b-e8cf-4959-b19b-03aef927af57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41a2d5b-7100-490d-bfae-db53a6e69a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:17 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume 6ef40e13-e969-4805-a6d6-7ce65d372db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef40e13-e969-4805-a6d6-7ce65d372db7', 'volume_size': 1}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1506534929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef40e13-e969-4805-a6d6-7ce65d372db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea405c452f04df18b06fe699802e0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:17Z,use_quota=True,user_id='2c422637ae5944f29e1f0dc19d48233e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Creating volume 6ef40e13-e969-4805-a6d6-7ce65d372db7 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:17 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6ef40e13-e969-4805-a6d6-7ce65d372db7 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:17 devstack sudo[90340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6ef40e13-e969-4805-a6d6-7ce65d372db7 1073741824
Apr 16 19:55:17 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:17 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6ef40e13-e969-4805-a6d6-7ce65d372db7 1073741824" returned: 0 in 0.479s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6ef40e13-e969-4805-a6d6-7ce65d372db7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:17 devstack sudo[90345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6ef40e13-e969-4805-a6d6-7ce65d372db7
Apr 16 19:55:17 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:17 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6ef40e13-e969-4805-a6d6-7ce65d372db7" returned: 0 in 0.426s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41a2d5b-7100-490d-bfae-db53a6e69a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef40e13-e969-4805-a6d6-7ce65d372db7', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28e78a6-f99b-44dc-b667-8341d7476f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:17 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume volume-6ef40e13-e969-4805-a6d6-7ce65d372db7 (6ef40e13-e969-4805-a6d6-7ce65d372db7): created successfully
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28e78a6-f99b-44dc-b667-8341d7476f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Flow 'volume_create_manager' (1e77d8a4-985b-45fa-ad24-c7776cebe5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:17 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7e231432-1c3e-4be8-8d13-a23dfcddf923 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Created volume successfully.
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Flow 'volume_create_manager' (508a1b7f-04b9-42ca-8d71-1de11e49e9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be8cb0d-dc6c-4b8e-9e09-3fb6709fdc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be8cb0d-dc6c-4b8e-9e09-3fb6709fdc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660497801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8286b5-6708-49e3-a368-f2e297ab73a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea405c452f04df18b06fe699802e0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:19Z,use_quota=True,user_id='2c422637ae5944f29e1f0dc19d48233e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bfbde5-7c88-40f6-a179-eda68a4ae2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bfbde5-7c88-40f6-a179-eda68a4ae2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad85b5fe-d93d-4c81-84f8-a8b74a49e933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad85b5fe-d93d-4c81-84f8-a8b74a49e933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8286b5-6708-49e3-a368-f2e297ab73a1', 'volume_name': 'volume-1f8286b5-6708-49e3-a368-f2e297ab73a1', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2438f8-992b-4e00-824d-884e874cfbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2438f8-992b-4e00-824d-884e874cfbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8167c7e-dd4b-4303-88f6-68c5284fbc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume 1f8286b5-6708-49e3-a368-f2e297ab73a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8286b5-6708-49e3-a368-f2e297ab73a1', 'volume_size': 1}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660497801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8286b5-6708-49e3-a368-f2e297ab73a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea405c452f04df18b06fe699802e0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:19Z,use_quota=True,user_id='2c422637ae5944f29e1f0dc19d48233e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Creating volume 1f8286b5-6708-49e3-a368-f2e297ab73a1 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:19 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f8286b5-6708-49e3-a368-f2e297ab73a1 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:19 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f8286b5-6708-49e3-a368-f2e297ab73a1 1073741824
Apr 16 19:55:19 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Flow 'volume_create_manager' (10622131-b288-4953-be38-38eb62eca884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e810db-db6c-4cf3-b783-4bb4f3d0f161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e810db-db6c-4cf3-b783-4bb4f3d0f161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-686848770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d52828c-96a6-4e2a-9f28-5c3dc10a46f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea405c452f04df18b06fe699802e0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:19Z,use_quota=True,user_id='2c422637ae5944f29e1f0dc19d48233e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d2244b-7a38-4068-9cd6-c50546093f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d2244b-7a38-4068-9cd6-c50546093f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b4a310-44c1-4af4-8cb6-40cf46a46fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b4a310-44c1-4af4-8cb6-40cf46a46fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d52828c-96a6-4e2a-9f28-5c3dc10a46f6', 'volume_name': 'volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca98126-bc1a-4700-8daf-4578325f7241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca98126-bc1a-4700-8daf-4578325f7241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a48908-a127-40e6-a55f-5d33bfab3a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume 4d52828c-96a6-4e2a-9f28-5c3dc10a46f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6', 'volume_size': 1}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Flow 'volume_create_manager' (7e328a3a-7f8d-4e4f-9cec-002876e2b966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88637971-fcb7-4833-9ef2-8c57cefd7379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88637971-fcb7-4833-9ef2-8c57cefd7379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1199663537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89683e8a-70f5-4838-8528-8ef61970cf3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea405c452f04df18b06fe699802e0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:20Z,use_quota=True,user_id='2c422637ae5944f29e1f0dc19d48233e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1bb373-91e5-44a1-a19e-453c8a216cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1bb373-91e5-44a1-a19e-453c8a216cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d94544-710c-4186-a344-46d5181c05f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d94544-710c-4186-a344-46d5181c05f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89683e8a-70f5-4838-8528-8ef61970cf3c', 'volume_name': 'volume-89683e8a-70f5-4838-8528-8ef61970cf3c', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c0634b-69e7-497c-b975-6a26e457142d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c0634b-69e7-497c-b975-6a26e457142d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb1a5b0-18a1-4e91-b515-29abf996263f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume 89683e8a-70f5-4838-8528-8ef61970cf3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89683e8a-70f5-4838-8528-8ef61970cf3c', 'volume_size': 1}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Flow 'volume_create_manager' (4e49a514-f705-4a64-9405-d2bc2b9a26b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e306e5d3-f816-47c2-8f85-99763f249480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e306e5d3-f816-47c2-8f85-99763f249480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574088016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badfdfaf-36d4-4de3-828a-b1ad814a56ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea405c452f04df18b06fe699802e0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:20Z,use_quota=True,user_id='2c422637ae5944f29e1f0dc19d48233e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092f53a9-bc75-4e53-b8f4-c9c1670e68ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092f53a9-bc75-4e53-b8f4-c9c1670e68ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b63b22-afad-435c-abae-a44b883a1484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b63b22-afad-435c-abae-a44b883a1484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'badfdfaf-36d4-4de3-828a-b1ad814a56ec', 'volume_name': 'volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4322bc59-c42a-4381-9276-2039dd08d3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4322bc59-c42a-4381-9276-2039dd08d3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa16ed6-9021-4430-8084-872726038eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:19 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume badfdfaf-36d4-4de3-828a-b1ad814a56ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec', 'volume_size': 1}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f8286b5-6708-49e3-a368-f2e297ab73a1 1073741824" returned: 0 in 0.616s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f8286b5-6708-49e3-a368-f2e297ab73a1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:20 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f8286b5-6708-49e3-a368-f2e297ab73a1
Apr 16 19:55:20 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Flow 'volume_create_manager' (e3e94d94-3eed-4eb1-b56d-a7fcbe66c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39753e55-2bb0-4f24-8d13-be46319ce3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39753e55-2bb0-4f24-8d13-be46319ce3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1065991753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146c1c06-ab83-4b7c-a8bd-85f9eb367931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea405c452f04df18b06fe699802e0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:20Z,use_quota=True,user_id='2c422637ae5944f29e1f0dc19d48233e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df82498a-24e7-4750-b996-a62c967f713b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df82498a-24e7-4750-b996-a62c967f713b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e18189-5184-4398-9373-3c85e04f39f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e18189-5184-4398-9373-3c85e04f39f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146c1c06-ab83-4b7c-a8bd-85f9eb367931', 'volume_name': 'volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ece1e0-4642-4345-b58d-0cad2d28c4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ece1e0-4642-4345-b58d-0cad2d28c4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46519ff-aabd-4fcf-8b08-42b5e89c3087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:20 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume 146c1c06-ab83-4b7c-a8bd-85f9eb367931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931', 'volume_size': 1}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:20 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f8286b5-6708-49e3-a368-f2e297ab73a1" returned: 0 in 0.440s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.902s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-686848770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d52828c-96a6-4e2a-9f28-5c3dc10a46f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea405c452f04df18b06fe699802e0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:19Z,use_quota=True,user_id='2c422637ae5944f29e1f0dc19d48233e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Creating volume 4d52828c-96a6-4e2a-9f28-5c3dc10a46f6 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:20 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8167c7e-dd4b-4303-88f6-68c5284fbc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8286b5-6708-49e3-a368-f2e297ab73a1', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ba0244-6ea6-407b-a14b-486fc15e7bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:20 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6 1073741824
Apr 16 19:55:20 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:20 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume volume-1f8286b5-6708-49e3-a368-f2e297ab73a1 (1f8286b5-6708-49e3-a368-f2e297ab73a1): created successfully
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ba0244-6ea6-407b-a14b-486fc15e7bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Flow 'volume_create_manager' (508a1b7f-04b9-42ca-8d71-1de11e49e9d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:20 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-cad657b9-c95f-4100-9c06-d9b71aeb7f56 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Created volume successfully.
Apr 16 19:55:20 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6 1073741824" returned: 0 in 0.499s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:20 devstack sudo[90361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6
Apr 16 19:55:20 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:21 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6" returned: 0 in 0.436s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.627s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1199663537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89683e8a-70f5-4838-8528-8ef61970cf3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea405c452f04df18b06fe699802e0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:20Z,use_quota=True,user_id='2c422637ae5944f29e1f0dc19d48233e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Creating volume 89683e8a-70f5-4838-8528-8ef61970cf3c {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:21 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-89683e8a-70f5-4838-8528-8ef61970cf3c 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a48908-a127-40e6-a55f-5d33bfab3a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d540c5b9-688b-4479-89e6-2b5e4546f0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:21 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-89683e8a-70f5-4838-8528-8ef61970cf3c 1073741824
Apr 16 19:55:21 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:21 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6 (4d52828c-96a6-4e2a-9f28-5c3dc10a46f6): created successfully
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d540c5b9-688b-4479-89e6-2b5e4546f0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Flow 'volume_create_manager' (10622131-b288-4953-be38-38eb62eca884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:21 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-4177095d-7c5f-44ae-8eb1-4ad7a5e52f2f tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Created volume successfully.
Apr 16 19:55:21 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-89683e8a-70f5-4838-8528-8ef61970cf3c 1073741824" returned: 0 in 0.508s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-89683e8a-70f5-4838-8528-8ef61970cf3c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:21 devstack sudo[90369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-89683e8a-70f5-4838-8528-8ef61970cf3c
Apr 16 19:55:21 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:22 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-89683e8a-70f5-4838-8528-8ef61970cf3c" returned: 0 in 0.413s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.386s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574088016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badfdfaf-36d4-4de3-828a-b1ad814a56ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea405c452f04df18b06fe699802e0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:20Z,use_quota=True,user_id='2c422637ae5944f29e1f0dc19d48233e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Creating volume badfdfaf-36d4-4de3-828a-b1ad814a56ec {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:22 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb1a5b0-18a1-4e91-b515-29abf996263f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89683e8a-70f5-4838-8528-8ef61970cf3c', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1a2d70-2d0e-433c-bcdb-d32fb6c60a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:22 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec 1073741824
Apr 16 19:55:22 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:UPDATE=202,cinder:SELECT=146,cinder:INSERT=58,cinder:DELETE=17 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:55:22 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume volume-89683e8a-70f5-4838-8528-8ef61970cf3c (89683e8a-70f5-4838-8528-8ef61970cf3c): created successfully
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1a2d70-2d0e-433c-bcdb-d32fb6c60a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Flow 'volume_create_manager' (7e328a3a-7f8d-4e4f-9cec-002876e2b966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:22 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c7660e30-4cb4-43a9-a04a-1a845aa42ab3 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Created volume successfully.
Apr 16 19:55:22 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec 1073741824" returned: 0 in 0.495s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:22 devstack sudo[90377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec
Apr 16 19:55:22 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:23 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec" returned: 0 in 0.408s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.128s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1065991753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146c1c06-ab83-4b7c-a8bd-85f9eb367931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea405c452f04df18b06fe699802e0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:20Z,use_quota=True,user_id='2c422637ae5944f29e1f0dc19d48233e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Creating volume 146c1c06-ab83-4b7c-a8bd-85f9eb367931 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:23 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa16ed6-9021-4430-8084-872726038eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:23 devstack sudo[90380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931 1073741824
Apr 16 19:55:23 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b289d9d-e76a-4076-98a0-d85ca2b05ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=149,cinder:UPDATE=198,cinder:INSERT=46,cinder:DELETE=16 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:55:23 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec (badfdfaf-36d4-4de3-828a-b1ad814a56ec): created successfully
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b289d9d-e76a-4076-98a0-d85ca2b05ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Flow 'volume_create_manager' (4e49a514-f705-4a64-9405-d2bc2b9a26b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:23 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-93d0a54b-9a5d-480e-a606-53281bdfd862 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Created volume successfully.
Apr 16 19:55:23 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931 1073741824" returned: 0 in 0.512s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:23 devstack sudo[90385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931
Apr 16 19:55:23 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:24 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931" returned: 0 in 0.415s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:24 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46519ff-aabd-4fcf-8b08-42b5e89c3087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f7e5e3-c027-4b1c-80b8-9e10ed961867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:24 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Volume volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931 (146c1c06-ab83-4b7c-a8bd-85f9eb367931): created successfully
Apr 16 19:55:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f7e5e3-c027-4b1c-80b8-9e10ed961867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:24 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Flow 'volume_create_manager' (e3e94d94-3eed-4eb1-b56d-a7fcbe66c329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:24 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-27dd013d-d7c5-44cf-8301-6c4e44d1c608 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Created volume successfully.
Apr 16 19:55:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "cinder-146c1c06-ab83-4b7c-a8bd-85f9eb367931-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-146c1c06-ab83-4b7c-a8bd-85f9eb367931-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "cinder-quobyte-146c1c06-ab83-4b7c-a8bd-85f9eb367931" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:24 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-quobyte-146c1c06-ab83-4b7c-a8bd-85f9eb367931" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:24 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c89fe0-41e3-4655-8483-c567a45a12d6]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:24 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:24 devstack sudo[90389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931
Apr 16 19:55:24 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:25 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931" returned: 0 in 0.466s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:25 devstack sudo[90395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931
Apr 16 19:55:25 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:25 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-146c1c06-ab83-4b7c-a8bd-85f9eb367931" returned: 0 in 0.407s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-quobyte-146c1c06-ab83-4b7c-a8bd-85f9eb367931" released by "delete_volume" :: held 0.902s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Created reservations ['909e5fd0-7ff4-422b-8b8d-3e444a435ecf', '373da67f-b83a-477a-a51a-55146f28f5c5', '18445bb1-edca-4efd-bc26-ec4520355849', '377a7784-e615-414f-9bad-5ce4ef972f34'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:25 devstack sudo[90398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:25 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "cinder-badfdfaf-36d4-4de3-828a-b1ad814a56ec-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-badfdfaf-36d4-4de3-828a-b1ad814a56ec-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "cinder-quobyte-badfdfaf-36d4-4de3-828a-b1ad814a56ec" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-quobyte-badfdfaf-36d4-4de3-828a-b1ad814a56ec" acquired by "delete_volume" :: waited 0.020s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4df0eb-9f81-4bf0-890f-eb3ebd72698f]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:25 devstack sudo[90400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec
Apr 16 19:55:25 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:25 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.425s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:25 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Deleted volume successfully.
Apr 16 19:55:25 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a7f18fe0-7b91-49d0-bb4c-72364872f7cc tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-146c1c06-ab83-4b7c-a8bd-85f9eb367931-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:26 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec" returned: 0 in 0.481s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:26 devstack sudo[90406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec
Apr 16 19:55:26 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:26 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-badfdfaf-36d4-4de3-828a-b1ad814a56ec" returned: 0 in 0.439s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-quobyte-badfdfaf-36d4-4de3-828a-b1ad814a56ec" released by "delete_volume" :: held 0.944s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Created reservations ['9cd2ced6-aef3-4c55-8ff8-a63feff62b3d', 'd021ac1b-1b9e-4aa4-81ea-fc6515f52927', '51890879-3049-42df-a163-dd563636fd1a', '9e59679c-c27e-4cbf-ad54-97bc8d616568'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:26 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:26 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "cinder-89683e8a-70f5-4838-8528-8ef61970cf3c-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-89683e8a-70f5-4838-8528-8ef61970cf3c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "cinder-quobyte-89683e8a-70f5-4838-8528-8ef61970cf3c" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-quobyte-89683e8a-70f5-4838-8528-8ef61970cf3c" acquired by "delete_volume" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ed85a3-c72a-4739-9e60-7945b92b4f00]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-89683e8a-70f5-4838-8528-8ef61970cf3c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:26 devstack sudo[90411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-89683e8a-70f5-4838-8528-8ef61970cf3c
Apr 16 19:55:26 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:27 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.432s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:27 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Deleted volume successfully.
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-71e7f30a-95f7-4d80-b169-9fe2d388b9b5 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-badfdfaf-36d4-4de3-828a-b1ad814a56ec-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:27 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-89683e8a-70f5-4838-8528-8ef61970cf3c" returned: 0 in 0.484s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-89683e8a-70f5-4838-8528-8ef61970cf3c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:27 devstack sudo[90417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-89683e8a-70f5-4838-8528-8ef61970cf3c
Apr 16 19:55:27 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:27 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-89683e8a-70f5-4838-8528-8ef61970cf3c" returned: 0 in 0.414s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-quobyte-89683e8a-70f5-4838-8528-8ef61970cf3c" released by "delete_volume" :: held 0.919s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Created reservations ['8a56883e-0f9c-4991-9456-e5392c837aec', 'c9d9e326-3a20-4c59-9faa-a3624d0149ef', 'c58e521f-8031-433b-a302-daa0829c9873', '9294af51-ddc9-4cc2-a489-b3da224c889d'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:27 devstack sudo[90420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:27 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "cinder-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "cinder-quobyte-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-quobyte-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6" acquired by "delete_volume" :: waited 0.017s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c93e9e0-5698-4753-ab55-7bf53a1a6b2a]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:28 devstack sudo[90422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6
Apr 16 19:55:28 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:28 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.428s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:28 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Deleted volume successfully.
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-77e74196-0893-4ad3-ab9c-30e45c17c8c4 tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-89683e8a-70f5-4838-8528-8ef61970cf3c-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:28 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6" returned: 0 in 0.479s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:28 devstack sudo[90428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6
Apr 16 19:55:28 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:28 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6" returned: 0 in 0.445s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-quobyte-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6" released by "delete_volume" :: held 0.946s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Created reservations ['71b9fb78-5c76-4d06-a827-38d64871ecd3', 'dbc0d319-7383-4395-b4ac-89991bc210ad', 'b55be2f4-2842-4f2c-95d4-3b9ea09d4df5', '55f4831e-a872-439e-8b94-b03a8c00d7d4'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:28 devstack sudo[90431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:28 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "cinder-1f8286b5-6708-49e3-a368-f2e297ab73a1-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-1f8286b5-6708-49e3-a368-f2e297ab73a1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "cinder-quobyte-1f8286b5-6708-49e3-a368-f2e297ab73a1" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-quobyte-1f8286b5-6708-49e3-a368-f2e297ab73a1" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:29 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[863909a4-f4f8-467e-b65f-24bbcc3c4221]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f8286b5-6708-49e3-a368-f2e297ab73a1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:29 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f8286b5-6708-49e3-a368-f2e297ab73a1
Apr 16 19:55:29 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:29 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.432s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:29 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:29 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Deleted volume successfully.
Apr 16 19:55:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7dbb7164-c10d-438c-9c18-9f6b9a1fdaef tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-4d52828c-96a6-4e2a-9f28-5c3dc10a46f6-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:29 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f8286b5-6708-49e3-a368-f2e297ab73a1" returned: 0 in 0.497s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f8286b5-6708-49e3-a368-f2e297ab73a1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:29 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f8286b5-6708-49e3-a368-f2e297ab73a1
Apr 16 19:55:29 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:29 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-1f8286b5-6708-49e3-a368-f2e297ab73a1" returned: 0 in 0.409s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-quobyte-1f8286b5-6708-49e3-a368-f2e297ab73a1" released by "delete_volume" :: held 0.931s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Created reservations ['1580ff33-8dd0-4e5e-91d5-422713fbadcf', 'b308af54-5c33-455d-a761-0709522ac961', 'cf5838dd-9da5-4a90-a9fa-c5a5a47bb778', '7fad3047-2a93-4204-b370-4cfc5bf6fb68'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:30 devstack sudo[90443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:30 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "cinder-6ef40e13-e969-4805-a6d6-7ce65d372db7-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-6ef40e13-e969-4805-a6d6-7ce65d372db7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "cinder-quobyte-6ef40e13-e969-4805-a6d6-7ce65d372db7" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-quobyte-6ef40e13-e969-4805-a6d6-7ce65d372db7" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[421fe43b-9703-4094-a861-3a5f0a3a1406]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6ef40e13-e969-4805-a6d6-7ce65d372db7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:30 devstack sudo[90445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6ef40e13-e969-4805-a6d6-7ce65d372db7
Apr 16 19:55:30 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:30 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.427s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:30 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Deleted volume successfully.
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a77f8fac-b390-4af7-8bfb-664cbc89517b tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-1f8286b5-6708-49e3-a368-f2e297ab73a1-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:30 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6ef40e13-e969-4805-a6d6-7ce65d372db7" returned: 0 in 0.505s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6ef40e13-e969-4805-a6d6-7ce65d372db7 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:30 devstack sudo[90451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6ef40e13-e969-4805-a6d6-7ce65d372db7
Apr 16 19:55:30 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:31 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6ef40e13-e969-4805-a6d6-7ce65d372db7" returned: 0 in 0.408s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-quobyte-6ef40e13-e969-4805-a6d6-7ce65d372db7" released by "delete_volume" :: held 0.935s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:31 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Created reservations ['74e0cfb3-351b-4728-a221-310f93321ad1', '94aa7b5c-844a-47ab-9973-48ad0babc1be', '1a30969f-c17f-46f4-95b1-2c159b7e4d2f', 'a05e6dfc-0009-45c1-8770-74123e17289d'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:31 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:31 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:31 devstack sudo[90460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:31 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:31 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.431s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:31 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:31 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Deleted volume successfully.
Apr 16 19:55:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-3a585cae-195d-4dff-8500-ea64eeeab6ce tempest-CreateVolumesFromSourceVolumeTest-1305896437 None] Lock "cinder-6ef40e13-e969-4805-a6d6-7ce65d372db7-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Flow 'volume_create_manager' (c92508cb-877f-4744-bce3-56bc238af97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a24a9b9-314f-48ae-8dcf-c55b28387607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a24a9b9-314f-48ae-8dcf-c55b28387607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-324261456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291a294f-9757-4fa0-a09e-77b412169d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129a97b46a8a4cc4a819f7aa22d096e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:38Z,use_quota=True,user_id='721cc0860e764f349ed3f19b4f616d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f8a645-d0c5-4bb0-a7e4-8f1546b66ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f8a645-d0c5-4bb0-a7e4-8f1546b66ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff52c882-128b-4675-aef4-58758685cf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff52c882-128b-4675-aef4-58758685cf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '291a294f-9757-4fa0-a09e-77b412169d5c', 'volume_name': 'volume-291a294f-9757-4fa0-a09e-77b412169d5c', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150f32be-ad55-4f18-87f7-902728549588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150f32be-ad55-4f18-87f7-902728549588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be966c7-d226-46d3-8c45-e2b3409b7136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume 291a294f-9757-4fa0-a09e-77b412169d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-291a294f-9757-4fa0-a09e-77b412169d5c', 'volume_size': 1}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-324261456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291a294f-9757-4fa0-a09e-77b412169d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129a97b46a8a4cc4a819f7aa22d096e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:38Z,use_quota=True,user_id='721cc0860e764f349ed3f19b4f616d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Creating volume 291a294f-9757-4fa0-a09e-77b412169d5c {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:38 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:38 devstack sudo[90506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c 1073741824
Apr 16 19:55:38 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Flow 'volume_create_manager' (a0a2de68-dea5-430a-bdb9-7dabdc5d35f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82223dfb-58da-4e26-9054-17f88a81d045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82223dfb-58da-4e26-9054-17f88a81d045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-681534031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a117b84-46a6-4601-9b64-9cc801af2bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77f0d4c5da9411a88a90dec9fa63749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:38Z,use_quota=True,user_id='5ec065e5e9444b8091285a6753525163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce04a34d-9afc-4750-83a5-527f852e1285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce04a34d-9afc-4750-83a5-527f852e1285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0309d3-be4e-4f9d-a147-7a2a64fdb81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0309d3-be4e-4f9d-a147-7a2a64fdb81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a117b84-46a6-4601-9b64-9cc801af2bef', 'volume_name': 'volume-3a117b84-46a6-4601-9b64-9cc801af2bef', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c44d4f6-c37e-42e1-9ab4-5c9d945f21e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c44d4f6-c37e-42e1-9ab4-5c9d945f21e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2f1acb-be25-406c-8233-09301c335c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Volume 3a117b84-46a6-4601-9b64-9cc801af2bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a117b84-46a6-4601-9b64-9cc801af2bef', 'volume_size': 1}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Flow 'volume_create_manager' (4d6bb854-4050-44af-813e-8a9dd86535ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7547e2c-7e42-4ad3-aacb-489243b4728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7547e2c-7e42-4ad3-aacb-489243b4728e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1269815004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986f6d9a-8c67-4494-ab52-fd8f43471974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1577084808a248e88c89077cc4029157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:39Z,use_quota=True,user_id='5014ca17832b4311a4eaea192524e9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0345c60-2d2a-43b6-b4d6-5aad9103b6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0345c60-2d2a-43b6-b4d6-5aad9103b6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ed696d-6503-4bc9-b318-dc652211ce30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ed696d-6503-4bc9-b318-dc652211ce30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '986f6d9a-8c67-4494-ab52-fd8f43471974', 'volume_name': 'volume-986f6d9a-8c67-4494-ab52-fd8f43471974', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38bddb91-cd9c-49f9-b90e-af6acc0e7258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38bddb91-cd9c-49f9-b90e-af6acc0e7258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc25a48-dd22-4a38-b29c-334f12f2f09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Volume 986f6d9a-8c67-4494-ab52-fd8f43471974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-986f6d9a-8c67-4494-ab52-fd8f43471974', 'volume_size': 1}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Flow 'volume_create_manager' (ba6452b3-947c-4ce7-8cf1-56c3f1450236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78069726-fcdb-4835-b077-e0c30cda1999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78069726-fcdb-4835-b077-e0c30cda1999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-104272334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a463c744-7a7c-49a1-8fef-547ea3c5d72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939e6d3f814940a28b84c89ffc94fddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:39Z,use_quota=True,user_id='816c9267240547d0a3900d292ef7a1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a3bfa7-9454-4686-b0c0-e0eeea68face) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a3bfa7-9454-4686-b0c0-e0eeea68face) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a9bd7c-f3a9-4e8c-86d9-90a224a7dc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a9bd7c-f3a9-4e8c-86d9-90a224a7dc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a463c744-7a7c-49a1-8fef-547ea3c5d72e', 'volume_name': 'volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d385ad-047e-48da-9e6d-44f26630d846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d385ad-047e-48da-9e6d-44f26630d846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf82c2b-4d87-45d0-996e-34934b089aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume a463c744-7a7c-49a1-8fef-547ea3c5d72e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e', 'volume_size': 1}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Flow 'volume_create_manager' (75227e90-928f-4404-a066-6a74202f36d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd0dd9a-fdea-4077-820d-450010f38a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd0dd9a-fdea-4077-820d-450010f38a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1593761226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4847294b-ec56-4c0b-a7c9-f53b635e9202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1577084808a248e88c89077cc4029157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:39Z,use_quota=True,user_id='5014ca17832b4311a4eaea192524e9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329b6489-82ac-4ea4-baf4-b763d5ad12b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329b6489-82ac-4ea4-baf4-b763d5ad12b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4e56fa-964c-45eb-bdf6-fd06e48113b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4e56fa-964c-45eb-bdf6-fd06e48113b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4847294b-ec56-4c0b-a7c9-f53b635e9202', 'volume_name': 'volume-4847294b-ec56-4c0b-a7c9-f53b635e9202', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c585caa3-a4ca-4587-94ef-e7ccd4ed7b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c585caa3-a4ca-4587-94ef-e7ccd4ed7b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4a98fe-8808-4fbe-82a6-ceabe4b1880e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Volume 4847294b-ec56-4c0b-a7c9-f53b635e9202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4847294b-ec56-4c0b-a7c9-f53b635e9202', 'volume_size': 1}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:39 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c 1073741824" returned: 0 in 0.646s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:39 devstack sudo[90511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c
Apr 16 19:55:39 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Flow 'volume_create_manager' (1e43cc72-da42-455e-a36d-8c970a97ddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666763c1-4f58-4f63-88b5-cc929bc1003d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666763c1-4f58-4f63-88b5-cc929bc1003d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-353701485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84db096c-3b92-4519-9378-a218696e58f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1577084808a248e88c89077cc4029157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:39Z,use_quota=True,user_id='5014ca17832b4311a4eaea192524e9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d848e803-0f5a-4a98-9725-e24c7e570bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d848e803-0f5a-4a98-9725-e24c7e570bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d9325c-168f-4bc8-bcf7-61a64b576eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d9325c-168f-4bc8-bcf7-61a64b576eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84db096c-3b92-4519-9378-a218696e58f9', 'volume_name': 'volume-84db096c-3b92-4519-9378-a218696e58f9', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc3f57e-9204-4326-b586-12e3f33b1339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc3f57e-9204-4326-b586-12e3f33b1339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76bd1efd-e550-462a-be6f-a69f45e45cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Volume 84db096c-3b92-4519-9378-a218696e58f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84db096c-3b92-4519-9378-a218696e58f9', 'volume_size': 1}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Flow 'volume_create_manager' (e190d03e-308d-483d-acf5-16d176b5205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c2eac9-fb6f-4020-8c4c-6c8a345a8c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c2eac9-fb6f-4020-8c4c-6c8a345a8c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-982198421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d4fdb3-d87f-4d30-aeef-4b95f377d4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1577084808a248e88c89077cc4029157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:39Z,use_quota=True,user_id='5014ca17832b4311a4eaea192524e9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d169621-88cb-485b-9970-8e40f6e86113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d169621-88cb-485b-9970-8e40f6e86113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01adbae1-19c6-474e-9d4d-165caf0e3dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01adbae1-19c6-474e-9d4d-165caf0e3dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58d4fdb3-d87f-4d30-aeef-4b95f377d4fe', 'volume_name': 'volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2fcdb9-abd0-440f-bedd-e022bc6acb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2fcdb9-abd0-440f-bedd-e022bc6acb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e737393b-d981-4d82-9e06-3beb754a7315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Volume 58d4fdb3-d87f-4d30-aeef-4b95f377d4fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe', 'volume_size': 1}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Flow 'volume_create_manager' (01ca563f-4d9b-41c2-a393-c6c2fca55733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde752d9-8b62-40b3-afbd-25d6e3a41004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde752d9-8b62-40b3-afbd-25d6e3a41004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1622980864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6809abe1-d51b-4f64-8ce4-7d71e83a5981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1577084808a248e88c89077cc4029157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:40Z,use_quota=True,user_id='5014ca17832b4311a4eaea192524e9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947f4074-6a59-4c05-9a19-1d38c0357745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947f4074-6a59-4c05-9a19-1d38c0357745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17adbbc-94d7-4736-8727-8a35dcee37c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17adbbc-94d7-4736-8727-8a35dcee37c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6809abe1-d51b-4f64-8ce4-7d71e83a5981', 'volume_name': 'volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09efb714-cb39-4034-afaa-84baf16b9c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09efb714-cb39-4034-afaa-84baf16b9c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c2b7c0-0da7-4c97-af4f-673dc67d4c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Volume 6809abe1-d51b-4f64-8ce4-7d71e83a5981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981', 'volume_size': 1}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:39 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c" returned: 0 in 0.469s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.038s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-681534031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a117b84-46a6-4601-9b64-9cc801af2bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77f0d4c5da9411a88a90dec9fa63749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:38Z,use_quota=True,user_id='5ec065e5e9444b8091285a6753525163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Creating volume 3a117b84-46a6-4601-9b64-9cc801af2bef {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:39 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be966c7-d226-46d3-8c45-e2b3409b7136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-291a294f-9757-4fa0-a09e-77b412169d5c', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack sudo[90514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef 1073741824
Apr 16 19:55:39 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eda64ff-5140-425d-b808-4b2c996e8fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:39 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume volume-291a294f-9757-4fa0-a09e-77b412169d5c (291a294f-9757-4fa0-a09e-77b412169d5c): created successfully
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eda64ff-5140-425d-b808-4b2c996e8fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:39 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Flow 'volume_create_manager' (c92508cb-877f-4744-bce3-56bc238af97c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:39 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-b0da2b45-e208-40d6-b833-bac17a176169 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Created volume successfully.
Apr 16 19:55:40 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef 1073741824" returned: 0 in 0.490s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:40 devstack sudo[90519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef
Apr 16 19:55:40 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:40 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef" returned: 0 in 0.397s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.787s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1269815004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986f6d9a-8c67-4494-ab52-fd8f43471974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1577084808a248e88c89077cc4029157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:39Z,use_quota=True,user_id='5014ca17832b4311a4eaea192524e9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Creating volume 986f6d9a-8c67-4494-ab52-fd8f43471974 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:40 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-986f6d9a-8c67-4494-ab52-fd8f43471974 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2f1acb-be25-406c-8233-09301c335c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a117b84-46a6-4601-9b64-9cc801af2bef', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:40 devstack sudo[90522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-986f6d9a-8c67-4494-ab52-fd8f43471974 1073741824
Apr 16 19:55:40 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d47b2a2-b539-4491-bcca-de824b088b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:40 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Volume volume-3a117b84-46a6-4601-9b64-9cc801af2bef (3a117b84-46a6-4601-9b64-9cc801af2bef): created successfully
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d47b2a2-b539-4491-bcca-de824b088b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Flow 'volume_create_manager' (a0a2de68-dea5-430a-bdb9-7dabdc5d35f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:40 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-2a0cb488-aebb-47da-b96c-c385ed650554 tempest-VolumeDependencyTests-661061709 None] Created volume successfully.
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:41 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-986f6d9a-8c67-4494-ab52-fd8f43471974 1073741824" returned: 0 in 0.547s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-986f6d9a-8c67-4494-ab52-fd8f43471974 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:41 devstack sudo[90527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-986f6d9a-8c67-4494-ab52-fd8f43471974
Apr 16 19:55:41 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:41 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-986f6d9a-8c67-4494-ab52-fd8f43471974" returned: 0 in 0.403s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.604s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-104272334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a463c744-7a7c-49a1-8fef-547ea3c5d72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939e6d3f814940a28b84c89ffc94fddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:39Z,use_quota=True,user_id='816c9267240547d0a3900d292ef7a1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Creating volume a463c744-7a7c-49a1-8fef-547ea3c5d72e {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:41 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc25a48-dd22-4a38-b29c-334f12f2f09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-986f6d9a-8c67-4494-ab52-fd8f43471974', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0612f10-624a-484b-8e01-15f71c805133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:41 devstack sudo[90530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e 1073741824
Apr 16 19:55:41 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:41 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Volume volume-986f6d9a-8c67-4494-ab52-fd8f43471974 (986f6d9a-8c67-4494-ab52-fd8f43471974): created successfully
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0612f10-624a-484b-8e01-15f71c805133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:41 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Flow 'volume_create_manager' (4d6bb854-4050-44af-813e-8a9dd86535ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:41 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-24380646-0042-4f35-8cfb-fc71197e2fe7 tempest-CreateVolumesFromImageTest-197169957 None] Created volume successfully.
Apr 16 19:55:42 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e 1073741824" returned: 0 in 0.478s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:42 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e
Apr 16 19:55:42 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:42 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e" returned: 0 in 0.408s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.435s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1593761226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4847294b-ec56-4c0b-a7c9-f53b635e9202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1577084808a248e88c89077cc4029157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:39Z,use_quota=True,user_id='5014ca17832b4311a4eaea192524e9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Creating volume 4847294b-ec56-4c0b-a7c9-f53b635e9202 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:42 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4847294b-ec56-4c0b-a7c9-f53b635e9202 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf82c2b-4d87-45d0-996e-34934b089aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0cd0f7-de6e-480b-8b9a-c091be890300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:42 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4847294b-ec56-4c0b-a7c9-f53b635e9202 1073741824
Apr 16 19:55:42 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:42 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e (a463c744-7a7c-49a1-8fef-547ea3c5d72e): created successfully
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0cd0f7-de6e-480b-8b9a-c091be890300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Flow 'volume_create_manager' (ba6452b3-947c-4ce7-8cf1-56c3f1450236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:42 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-be84f882-add8-49f0-85c7-4b74841b99eb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Created volume successfully.
Apr 16 19:55:42 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4847294b-ec56-4c0b-a7c9-f53b635e9202 1073741824" returned: 0 in 0.472s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4847294b-ec56-4c0b-a7c9-f53b635e9202 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:42 devstack sudo[90628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4847294b-ec56-4c0b-a7c9-f53b635e9202
Apr 16 19:55:42 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Flow 'volume_create_manager' (ed346137-7891-42ba-89cd-f4f5ccffce52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e429636-a467-49a9-8bc2-4fe4cb010e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e429636-a467-49a9-8bc2-4fe4cb010e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2118180117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41031d80-0bb7-456f-a90a-c6210f5ec2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939e6d3f814940a28b84c89ffc94fddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:43Z,use_quota=True,user_id='816c9267240547d0a3900d292ef7a1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92668d7-24ca-4013-9f24-318a01c1d4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92668d7-24ca-4013-9f24-318a01c1d4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac94bcb-6212-4501-9063-0cafb67377af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac94bcb-6212-4501-9063-0cafb67377af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41031d80-0bb7-456f-a90a-c6210f5ec2b8', 'volume_name': 'volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293d0972-75e6-4016-90bb-adf09fb64600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293d0972-75e6-4016-90bb-adf09fb64600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86169c9b-3979-410a-aa76-5c98e3db7a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume 41031d80-0bb7-456f-a90a-c6210f5ec2b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8', 'volume_size': 1}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:43 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4847294b-ec56-4c0b-a7c9-f53b635e9202" returned: 0 in 0.446s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.154s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-353701485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84db096c-3b92-4519-9378-a218696e58f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1577084808a248e88c89077cc4029157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:39Z,use_quota=True,user_id='5014ca17832b4311a4eaea192524e9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Creating volume 84db096c-3b92-4519-9378-a218696e58f9 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:43 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-84db096c-3b92-4519-9378-a218696e58f9 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:43 devstack sudo[90631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-84db096c-3b92-4519-9378-a218696e58f9 1073741824
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4a98fe-8808-4fbe-82a6-ceabe4b1880e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4847294b-ec56-4c0b-a7c9-f53b635e9202', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafe22e3-50de-4c7f-b2c9-c00c0223e7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Volume volume-4847294b-ec56-4c0b-a7c9-f53b635e9202 (4847294b-ec56-4c0b-a7c9-f53b635e9202): created successfully
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafe22e3-50de-4c7f-b2c9-c00c0223e7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Flow 'volume_create_manager' (75227e90-928f-4404-a066-6a74202f36d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:43 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1f720fbe-d96d-4edd-8673-3945a99e2362 tempest-CreateVolumesFromImageTest-197169957 None] Created volume successfully.
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Flow 'volume_create_manager' (0f26a268-3a00-4f38-93a2-42b3f4fa6d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3468fc-f368-4b39-ad3c-21b9ab0cb92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3468fc-f368-4b39-ad3c-21b9ab0cb92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-811678344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2554149e-1d18-4d5b-8d45-45e946cbd85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939e6d3f814940a28b84c89ffc94fddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:43Z,use_quota=True,user_id='816c9267240547d0a3900d292ef7a1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65a3db4-cfc4-4aa6-aee0-8d841dc0c353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65a3db4-cfc4-4aa6-aee0-8d841dc0c353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f1bf74-68e4-4fb5-8c3e-abb86bb8cc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f1bf74-68e4-4fb5-8c3e-abb86bb8cc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2554149e-1d18-4d5b-8d45-45e946cbd85d', 'volume_name': 'volume-2554149e-1d18-4d5b-8d45-45e946cbd85d', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6f56af-ecb8-4018-99fb-4ccbf5fb0c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6f56af-ecb8-4018-99fb-4ccbf5fb0c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d58278a-54a4-4c80-bbd6-82769b7a7619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume 2554149e-1d18-4d5b-8d45-45e946cbd85d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2554149e-1d18-4d5b-8d45-45e946cbd85d', 'volume_size': 1}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Flow 'volume_create_manager' (f078f7d5-6325-43db-967e-2a082428aab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78a813d-bb1e-4cd6-a53b-dc90a0087b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78a813d-bb1e-4cd6-a53b-dc90a0087b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-868936751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ec9b81-52c3-424c-a4e6-aa2a072a9ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939e6d3f814940a28b84c89ffc94fddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:44Z,use_quota=True,user_id='816c9267240547d0a3900d292ef7a1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475114c7-725e-4109-be7d-be33a441754a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475114c7-725e-4109-be7d-be33a441754a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1894fe37-9cef-4792-83be-7631103e6e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1894fe37-9cef-4792-83be-7631103e6e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98ec9b81-52c3-424c-a4e6-aa2a072a9ff1', 'volume_name': 'volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842ce347-2599-45b4-9b5e-1d018b43abb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842ce347-2599-45b4-9b5e-1d018b43abb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fac7c23-3141-4630-90d3-9b935238ce2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume 98ec9b81-52c3-424c-a4e6-aa2a072a9ff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1', 'volume_size': 1}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Flow 'volume_create_manager' (29efe713-1bfe-4bc7-bf4d-e9ae5b4e6b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4745c8cd-c9ac-4919-875f-5b9cce2ab01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4745c8cd-c9ac-4919-875f-5b9cce2ab01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1219035024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96deb872-af79-41a4-96e8-b17d6faff577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939e6d3f814940a28b84c89ffc94fddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:44Z,use_quota=True,user_id='816c9267240547d0a3900d292ef7a1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ac7282-c232-4e05-9428-d6dac013f273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ac7282-c232-4e05-9428-d6dac013f273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03b9e45-572e-454d-97de-97f49df72405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03b9e45-572e-454d-97de-97f49df72405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96deb872-af79-41a4-96e8-b17d6faff577', 'volume_name': 'volume-96deb872-af79-41a4-96e8-b17d6faff577', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522eb9d9-8698-48f6-9868-149ac306ebd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522eb9d9-8698-48f6-9868-149ac306ebd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5677ac1-b352-4e37-923f-dbc9b8cb4f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:43 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume 96deb872-af79-41a4-96e8-b17d6faff577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96deb872-af79-41a4-96e8-b17d6faff577', 'volume_size': 1}
Apr 16 19:55:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:44 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-84db096c-3b92-4519-9378-a218696e58f9 1073741824" returned: 0 in 0.651s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-84db096c-3b92-4519-9378-a218696e58f9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:44 devstack sudo[90636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-84db096c-3b92-4519-9378-a218696e58f9
Apr 16 19:55:44 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Flow 'volume_create_manager' (0248e1ac-c4d2-4c02-b61f-b49796aa3b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dddb84cb-a493-44fd-a156-76b4b5ba9366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dddb84cb-a493-44fd-a156-76b4b5ba9366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1888139982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c874e96-95b2-471d-8284-8aaca0afdd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939e6d3f814940a28b84c89ffc94fddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:44Z,use_quota=True,user_id='816c9267240547d0a3900d292ef7a1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb3540b-8e14-461c-8d72-16bc702d0ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb3540b-8e14-461c-8d72-16bc702d0ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f40e28-9479-4f09-b276-e0e3491010be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f40e28-9479-4f09-b276-e0e3491010be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c874e96-95b2-471d-8284-8aaca0afdd53', 'volume_name': 'volume-6c874e96-95b2-471d-8284-8aaca0afdd53', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6f4c9f-bb81-404a-bafb-0ce005d4755b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6f4c9f-bb81-404a-bafb-0ce005d4755b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236e4b3f-3e42-4a6c-802d-e94f39708d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:44 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume 6c874e96-95b2-471d-8284-8aaca0afdd53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c874e96-95b2-471d-8284-8aaca0afdd53', 'volume_size': 1}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:44 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-84db096c-3b92-4519-9378-a218696e58f9" returned: 0 in 0.396s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.054s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-982198421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d4fdb3-d87f-4d30-aeef-4b95f377d4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1577084808a248e88c89077cc4029157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:39Z,use_quota=True,user_id='5014ca17832b4311a4eaea192524e9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Creating volume 58d4fdb3-d87f-4d30-aeef-4b95f377d4fe {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:44 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76bd1efd-e550-462a-be6f-a69f45e45cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84db096c-3b92-4519-9378-a218696e58f9', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1daee7-8fb2-4895-ae68-ff964ab6b5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:44 devstack sudo[90639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe 1073741824
Apr 16 19:55:44 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:44 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Volume volume-84db096c-3b92-4519-9378-a218696e58f9 (84db096c-3b92-4519-9378-a218696e58f9): created successfully
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1daee7-8fb2-4895-ae68-ff964ab6b5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Flow 'volume_create_manager' (1e43cc72-da42-455e-a36d-8c970a97ddf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:44 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-422ee77f-4065-46ce-af24-a1a008ff68ad tempest-CreateVolumesFromImageTest-197169957 None] Created volume successfully.
Apr 16 19:55:44 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe 1073741824" returned: 0 in 0.497s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:45 devstack sudo[90645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe
Apr 16 19:55:45 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:45 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe" returned: 0 in 0.442s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.844s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1622980864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6809abe1-d51b-4f64-8ce4-7d71e83a5981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1577084808a248e88c89077cc4029157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:40Z,use_quota=True,user_id='5014ca17832b4311a4eaea192524e9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Creating volume 6809abe1-d51b-4f64-8ce4-7d71e83a5981 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:45 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e737393b-d981-4d82-9e06-3beb754a7315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d348d9d1-344f-48f0-99d2-cb39438a0255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:45 devstack sudo[90648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981 1073741824
Apr 16 19:55:45 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:45 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Volume volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe (58d4fdb3-d87f-4d30-aeef-4b95f377d4fe): created successfully
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d348d9d1-344f-48f0-99d2-cb39438a0255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Flow 'volume_create_manager' (e190d03e-308d-483d-acf5-16d176b5205b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:45 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f4d2c98d-fc9b-4796-a534-3209b0290042 tempest-CreateVolumesFromImageTest-197169957 None] Created volume successfully.
Apr 16 19:55:45 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981 1073741824" returned: 0 in 0.479s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:45 devstack sudo[90653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981
Apr 16 19:55:45 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:46 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981" returned: 0 in 0.451s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.480s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c2b7c0-0da7-4c97-af4f-673dc67d4c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2d9267-e2e6-4282-bd4f-93425f070bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:46 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Creating offline snapshot 0482652f-9213-4ed8-a802-4f35fcaeb7eb of volume 291a294f-9757-4fa0-a09e-77b412169d5c {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:55:46 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Volume volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981 (6809abe1-d51b-4f64-8ce4-7d71e83a5981): created successfully
Apr 16 19:55:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2d9267-e2e6-4282-bd4f-93425f070bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:46 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Flow 'volume_create_manager' (01ca563f-4d9b-41c2-a393-c6c2fca55733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:46 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1831a3c1-6f82-41e9-848b-d3c93e2800c9]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:46 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-54a60fe7-662f-47d2-8568-9816f5c1e5d2 tempest-CreateVolumesFromImageTest-197169957 None] Created volume successfully.
Apr 16 19:55:46 devstack sudo[90656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c
Apr 16 19:55:46 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:46 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c" returned: 0 in 0.465s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:46 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:46 devstack sudo[90661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb 1G
Apr 16 19:55:46 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "cinder-6809abe1-d51b-4f64-8ce4-7d71e83a5981-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-6809abe1-d51b-4f64-8ce4-7d71e83a5981-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "cinder-quobyte-6809abe1-d51b-4f64-8ce4-7d71e83a5981" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:47 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-quobyte-6809abe1-d51b-4f64-8ce4-7d71e83a5981" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:47 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e97ab0-8d2c-4fc0-8e8a-f773d7b72354]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:47 devstack sudo[90663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981
Apr 16 19:55:47 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:47 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb 1G" returned: 0 in 0.532s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-291a294f-9757-4fa0-a09e-77b412169d5c -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:47 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-291a294f-9757-4fa0-a09e-77b412169d5c -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb
Apr 16 19:55:47 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:47 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981" returned: 0 in 0.494s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:47 devstack sudo[90673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981
Apr 16 19:55:47 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:47 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-291a294f-9757-4fa0-a09e-77b412169d5c -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb" returned: 0 in 0.432s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:47 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb is being set with open permissions: ugo+rw
Apr 16 19:55:47 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:47 devstack sudo[90678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb
Apr 16 19:55:47 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:48 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6809abe1-d51b-4f64-8ce4-7d71e83a5981" returned: 0 in 0.415s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-quobyte-6809abe1-d51b-4f64-8ce4-7d71e83a5981" released by "delete_volume" :: held 0.931s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Created reservations ['9c5819a3-c810-4ac9-ab1a-05e1a4f4e1c7', '082266d1-9117-4859-8c4d-74b76e5a66a5', '859af2fe-cd3a-4144-93fe-ce52bae90ff5', '44ea6465-341e-4241-9c5f-721bfc380518'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:48 devstack sudo[90681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:48 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "cinder-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "cinder-quobyte-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-quobyte-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe" acquired by "delete_volume" :: waited 0.025s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:48 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb" returned: 0 in 0.451s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb344dc-4e16-4134-a1b4-8603e5cf4a2a]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:48 devstack sudo[90685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.info
Apr 16 19:55:48 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:48 devstack sudo[90684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe
Apr 16 19:55:48 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:48 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.478s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:48 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Deleted volume successfully.
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-f66e358b-73a4-4fd5-bf87-373768234abc tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-6809abe1-d51b-4f64-8ce4-7d71e83a5981-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:48 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.info" returned: 0 in 0.461s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:48 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.info is being set with open permissions: ugo+rw
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:48 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe" returned: 0 in 0.502s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:48 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:48 devstack sudo[90693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.info
Apr 16 19:55:48 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:48 devstack sudo[90694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe
Apr 16 19:55:48 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:49 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.info" returned: 0 in 0.425s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.858s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.319s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:49 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] Creating offline snapshot 3584a3e1-b549-466e-875a-d07d2e79f0db of volume 3a117b84-46a6-4601-9b64-9cc801af2bef {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe" returned: 0 in 0.453s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[783d9871-291e-4341-baf5-120a4efe91ea]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:49 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1b54f57d-e62d-4e03-9712-fa7efb6cc962 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Create snapshot completed successfully
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-quobyte-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe" released by "delete_volume" :: held 1.009s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Created reservations ['18ee3b45-7497-4793-a804-dfec7c1d7c86', '85aa96fb-d847-4ffe-b65e-702a12b7ea81', '04f35102-168c-4686-bb6e-629e5c7a4e18', '96e1ee5d-b80d-4482-af90-6cf251d36055'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:49 devstack sudo[90699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef
Apr 16 19:55:49 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:49 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:49 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:49 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef" returned: 0 in 0.491s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:49 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.412s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:49 devstack sudo[90707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db 1G
Apr 16 19:55:49 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:49 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Deleted volume successfully.
Apr 16 19:55:49 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-02e4e884-bef9-4239-8320-150e6ddf54e0 tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-58d4fdb3-d87f-4d30-aeef-4b95f377d4fe-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:50 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db 1G" returned: 0 in 0.505s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a117b84-46a6-4601-9b64-9cc801af2bef -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:50 devstack sudo[90712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a117b84-46a6-4601-9b64-9cc801af2bef -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db
Apr 16 19:55:50 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "cinder-84db096c-3b92-4519-9378-a218696e58f9-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-84db096c-3b92-4519-9378-a218696e58f9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Flow 'volume_create_manager' (7308344c-e965-4356-8380-335391ac48b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceae4da0-0153-48b2-9b8c-f2e19e3e57ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceae4da0-0153-48b2-9b8c-f2e19e3e57ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-960200783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4dfcec-ef82-4b4a-902d-abc20601fd23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129a97b46a8a4cc4a819f7aa22d096e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:50Z,use_quota=True,user_id='721cc0860e764f349ed3f19b4f616d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deca2b75-660c-43be-abdd-9ae3b3d3b356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deca2b75-660c-43be-abdd-9ae3b3d3b356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552731d1-de21-4d5f-b759-f1bd117cf15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552731d1-de21-4d5f-b759-f1bd117cf15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4dfcec-ef82-4b4a-902d-abc20601fd23', 'volume_name': 'volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a13a469-e711-4cf6-a86a-6140474ab5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a13a469-e711-4cf6-a86a-6140474ab5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a33edbd-3200-451f-b237-4b88f8f6b3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume ee4dfcec-ef82-4b4a-902d-abc20601fd23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23', 'volume_size': 1}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "cinder-quobyte-84db096c-3b92-4519-9378-a218696e58f9" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-quobyte-84db096c-3b92-4519-9378-a218696e58f9" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bedee2-be04-4c8c-911d-bad23d359b30]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-84db096c-3b92-4519-9378-a218696e58f9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:50 devstack sudo[90714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-84db096c-3b92-4519-9378-a218696e58f9
Apr 16 19:55:50 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Flow 'volume_create_manager' (974e6fc8-903b-4f1b-aeff-f589c65f0184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95edcd58-ef02-49c4-bcbd-b8bdb7c527e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95edcd58-ef02-49c4-bcbd-b8bdb7c527e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-428433355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000f4629-8888-436b-a281-92d7fc8c64db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129a97b46a8a4cc4a819f7aa22d096e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:51Z,use_quota=True,user_id='721cc0860e764f349ed3f19b4f616d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b914554-2114-475c-8662-76d75d65e676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b914554-2114-475c-8662-76d75d65e676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:50 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d647c9b6-48c9-42a1-9be4-f8e7970e537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d647c9b6-48c9-42a1-9be4-f8e7970e537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '000f4629-8888-436b-a281-92d7fc8c64db', 'volume_name': 'volume-000f4629-8888-436b-a281-92d7fc8c64db', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16e48cd-e720-4d18-a8ae-ca7afa9f7de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16e48cd-e720-4d18-a8ae-ca7afa9f7de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c234fc30-0092-408f-aa3f-12a96b6cd5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume 000f4629-8888-436b-a281-92d7fc8c64db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-000f4629-8888-436b-a281-92d7fc8c64db', 'volume_size': 1}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a117b84-46a6-4601-9b64-9cc801af2bef -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db" returned: 0 in 0.552s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:50 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db is being set with open permissions: ugo+rw
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:50 devstack sudo[90719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db
Apr 16 19:55:50 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Flow 'volume_create_manager' (03fc0405-ec48-4761-9ea3-d0d2000ae601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c54c0ce-aba5-4667-9975-2715e21a9f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c54c0ce-aba5-4667-9975-2715e21a9f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-383729451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef8cbf2-aea8-469b-8285-4ad5c3e08930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129a97b46a8a4cc4a819f7aa22d096e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:51Z,use_quota=True,user_id='721cc0860e764f349ed3f19b4f616d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca885775-b5ec-4ea5-b83f-a5eb31a2f8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca885775-b5ec-4ea5-b83f-a5eb31a2f8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13b5ef6-d331-46fb-9897-4117b668821a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13b5ef6-d331-46fb-9897-4117b668821a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef8cbf2-aea8-469b-8285-4ad5c3e08930', 'volume_name': 'volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9f41f3-e258-4762-ba7d-a152279940be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9f41f3-e258-4762-ba7d-a152279940be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd2a627-92f7-4de1-bec9-d77c27645a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:50 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume 0ef8cbf2-aea8-469b-8285-4ad5c3e08930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930', 'volume_size': 1}
Apr 16 19:55:50 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:51 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-84db096c-3b92-4519-9378-a218696e58f9" returned: 0 in 0.509s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-84db096c-3b92-4519-9378-a218696e58f9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:51 devstack sudo[90724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-84db096c-3b92-4519-9378-a218696e58f9
Apr 16 19:55:51 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Flow 'volume_create_manager' (c1b9913e-0314-443e-969e-93cfbea405f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81eb6238-ff45-468f-b2ad-ddfee60a6035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81eb6238-ff45-468f-b2ad-ddfee60a6035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-468742437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c123928b-9acd-4b3f-96f2-cac9b7e91378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129a97b46a8a4cc4a819f7aa22d096e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:51Z,use_quota=True,user_id='721cc0860e764f349ed3f19b4f616d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42da4ebc-2712-4ed8-ada5-7d52933692ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42da4ebc-2712-4ed8-ada5-7d52933692ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b83dc7-6590-4794-8411-fd482590f0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b83dc7-6590-4794-8411-fd482590f0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c123928b-9acd-4b3f-96f2-cac9b7e91378', 'volume_name': 'volume-c123928b-9acd-4b3f-96f2-cac9b7e91378', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc69c6a-4099-4409-9d55-acb67ab12142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc69c6a-4099-4409-9d55-acb67ab12142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c6cbaa-7d13-43ce-add6-a8ce443bb746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:51 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume c123928b-9acd-4b3f-96f2-cac9b7e91378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c123928b-9acd-4b3f-96f2-cac9b7e91378', 'volume_size': 1}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:51 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Flow 'volume_create_manager' (9af0af6b-9249-4751-9097-cec8994dd2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ca7f66-fe7b-4884-94b0-9105bfc47909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db" returned: 0 in 0.507s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ca7f66-fe7b-4884-94b0-9105bfc47909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1649676643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdbb652-9fea-4936-ab5a-96c2702ebecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129a97b46a8a4cc4a819f7aa22d096e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:51Z,use_quota=True,user_id='721cc0860e764f349ed3f19b4f616d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d47846-9680-43b6-888b-690cde4060e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d47846-9680-43b6-888b-690cde4060e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9fb3f7b-e6f2-486e-a876-49156da2f39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9fb3f7b-e6f2-486e-a876-49156da2f39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcdbb652-9fea-4936-ab5a-96c2702ebecd', 'volume_name': 'volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242c328c-e3e6-4e4d-a78f-6942e2baff0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242c328c-e3e6-4e4d-a78f-6942e2baff0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0141ea-f406-42a1-8e70-231d05ec1d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:51 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume fcdbb652-9fea-4936-ab5a-96c2702ebecd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd', 'volume_size': 1}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:51 devstack sudo[90727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.info
Apr 16 19:55:51 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:51 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-84db096c-3b92-4519-9378-a218696e58f9" returned: 0 in 0.468s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-quobyte-84db096c-3b92-4519-9378-a218696e58f9" released by "delete_volume" :: held 1.000s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Created reservations ['e3babb0b-b519-4ae3-85a5-1e80ea2f7f58', '6bcd045f-be13-4828-b4d0-2b99b3aa37e7', 'b3de5e35-e7a2-4b41-bedd-a1d054bb820d', '48ccc776-7b7f-4f39-aa7e-3ab62f1dfc28'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:51 devstack sudo[90730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:51 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:51 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.info" returned: 0 in 0.445s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:51 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.info is being set with open permissions: ugo+rw
Apr 16 19:55:51 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:51 devstack sudo[90733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.info
Apr 16 19:55:51 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:52 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.402s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:52 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Deleted volume successfully.
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-9151b3ba-521e-4287-bda9-db53af903506 tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-84db096c-3b92-4519-9378-a218696e58f9-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:52 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.info" returned: 0 in 0.423s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.023s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.953s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2118180117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41031d80-0bb7-456f-a90a-c6210f5ec2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939e6d3f814940a28b84c89ffc94fddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:43Z,use_quota=True,user_id='816c9267240547d0a3900d292ef7a1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Creating volume 41031d80-0bb7-456f-a90a-c6210f5ec2b8 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:52 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:52 devstack sudo[90737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8 1073741824
Apr 16 19:55:52 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:52 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-2ad4b7d9-44b4-42db-9f68-ded77a5b0f58 tempest-VolumeDependencyTests-661061709 None] Create snapshot completed successfully
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "cinder-4847294b-ec56-4c0b-a7c9-f53b635e9202-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-4847294b-ec56-4c0b-a7c9-f53b635e9202-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "cinder-quobyte-4847294b-ec56-4c0b-a7c9-f53b635e9202" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-quobyte-4847294b-ec56-4c0b-a7c9-f53b635e9202" acquired by "delete_volume" :: waited 0.006s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefff442-4dc8-4a87-a7ac-ee669e95350a]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4847294b-ec56-4c0b-a7c9-f53b635e9202 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:52 devstack sudo[90739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4847294b-ec56-4c0b-a7c9-f53b635e9202
Apr 16 19:55:52 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:52 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8 1073741824" returned: 0 in 0.518s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:52 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:52 devstack sudo[90744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8
Apr 16 19:55:52 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:53 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4847294b-ec56-4c0b-a7c9-f53b635e9202" returned: 0 in 0.475s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4847294b-ec56-4c0b-a7c9-f53b635e9202 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:53 devstack sudo[90749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4847294b-ec56-4c0b-a7c9-f53b635e9202
Apr 16 19:55:53 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:53 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8" returned: 0 in 0.437s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.758s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-811678344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2554149e-1d18-4d5b-8d45-45e946cbd85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939e6d3f814940a28b84c89ffc94fddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:43Z,use_quota=True,user_id='816c9267240547d0a3900d292ef7a1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Creating volume 2554149e-1d18-4d5b-8d45-45e946cbd85d {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:53 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2554149e-1d18-4d5b-8d45-45e946cbd85d 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86169c9b-3979-410a-aa76-5c98e3db7a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643c856c-47e4-4475-b734-d8f45650e170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:53 devstack sudo[90752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2554149e-1d18-4d5b-8d45-45e946cbd85d 1073741824
Apr 16 19:55:53 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:53 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8 (41031d80-0bb7-456f-a90a-c6210f5ec2b8): created successfully
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643c856c-47e4-4475-b734-d8f45650e170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Flow 'volume_create_manager' (ed346137-7891-42ba-89cd-f4f5ccffce52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:53 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-00166662-0f41-493c-af2d-3a77890e5ab7 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Created volume successfully.
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Flow 'volume_create_manager' (3f1aa809-bca6-4c5d-a1c8-653c5d6f64fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:53 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171cf2af-c784-4a08-89c6-c64177a22ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-4847294b-ec56-4c0b-a7c9-f53b635e9202" returned: 0 in 0.498s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171cf2af-c784-4a08-89c6-c64177a22ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-855631100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10821c09-8749-4ab6-8c38-5dbc0661ecbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77f0d4c5da9411a88a90dec9fa63749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3584a3e1-b549-466e-875a-d07d2e79f0db,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:54Z,use_quota=True,user_id='5ec065e5e9444b8091285a6753525163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa5505d-5eff-4924-bfd3-f7278761692d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa5505d-5eff-4924-bfd3-f7278761692d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee413a64-04a0-4a55-9dca-c7307751c6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee413a64-04a0-4a55-9dca-c7307751c6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '10821c09-8749-4ab6-8c38-5dbc0661ecbe', 'volume_name': 'volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe', 'volume_size': 1, 'snapshot_id': '3584a3e1-b549-466e-875a-d07d2e79f0db'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a85045-ab38-4fa2-8435-6f81c2140e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a85045-ab38-4fa2-8435-6f81c2140e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25942748-4f72-4df0-a6e4-d343aabfb46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:53 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Volume 10821c09-8749-4ab6-8c38-5dbc0661ecbe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe', 'volume_size': 1, 'snapshot_id': '3584a3e1-b549-466e-875a-d07d2e79f0db'}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-quobyte-4847294b-ec56-4c0b-a7c9-f53b635e9202" released by "delete_volume" :: held 1.033s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Created reservations ['69d9e7b4-c69a-411b-be31-7a312e279bb8', 'de0fe2ba-4fa7-40cb-9b74-11514016ad47', '7fb0dc67-c8e8-4082-b3ec-41e66fa2c5ac', '5cab6dc3-7eff-4da5-9826-e5221a52005e'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:53 devstack sudo[90758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:53 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:53 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2554149e-1d18-4d5b-8d45-45e946cbd85d 1073741824" returned: 0 in 0.599s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:53 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2554149e-1d18-4d5b-8d45-45e946cbd85d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:53 devstack sudo[90760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2554149e-1d18-4d5b-8d45-45e946cbd85d
Apr 16 19:55:53 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:54 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.420s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:54 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Deleted volume successfully.
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-6cac89d1-7534-468c-827d-564408dcef0c tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-4847294b-ec56-4c0b-a7c9-f53b635e9202-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:54 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2554149e-1d18-4d5b-8d45-45e946cbd85d" returned: 0 in 0.436s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.624s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-868936751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ec9b81-52c3-424c-a4e6-aa2a072a9ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939e6d3f814940a28b84c89ffc94fddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:44Z,use_quota=True,user_id='816c9267240547d0a3900d292ef7a1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Creating volume 98ec9b81-52c3-424c-a4e6-aa2a072a9ff1 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:54 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d58278a-54a4-4c80-bbd6-82769b7a7619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2554149e-1d18-4d5b-8d45-45e946cbd85d', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:54 devstack sudo[90764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1 1073741824
Apr 16 19:55:54 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f1a8ae-0c74-4c06-aa5d-caa43f0bbc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:54 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume volume-2554149e-1d18-4d5b-8d45-45e946cbd85d (2554149e-1d18-4d5b-8d45-45e946cbd85d): created successfully
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f1a8ae-0c74-4c06-aa5d-caa43f0bbc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Flow 'volume_create_manager' (0f26a268-3a00-4f38-93a2-42b3f4fa6d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:54 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-17fae382-27ac-40a3-9d3c-d58a391a3f98 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Created volume successfully.
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "cinder-986f6d9a-8c67-4494-ab52-fd8f43471974-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-986f6d9a-8c67-4494-ab52-fd8f43471974-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "cinder-quobyte-986f6d9a-8c67-4494-ab52-fd8f43471974" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-quobyte-986f6d9a-8c67-4494-ab52-fd8f43471974" acquired by "delete_volume" :: waited 0.018s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e520fb7b-6bcd-4d3c-8de1-1f3264247a23]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-986f6d9a-8c67-4494-ab52-fd8f43471974 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:54 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1 1073741824" returned: 0 in 0.539s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:54 devstack sudo[90770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-986f6d9a-8c67-4494-ab52-fd8f43471974
Apr 16 19:55:54 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:54 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:54 devstack sudo[90772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1
Apr 16 19:55:54 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:55 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-986f6d9a-8c67-4494-ab52-fd8f43471974" returned: 0 in 0.464s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-986f6d9a-8c67-4494-ab52-fd8f43471974 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:55 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1" returned: 0 in 0.407s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:55 devstack sudo[90778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-986f6d9a-8c67-4494-ab52-fd8f43471974
Apr 16 19:55:55 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.405s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1219035024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96deb872-af79-41a4-96e8-b17d6faff577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939e6d3f814940a28b84c89ffc94fddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:44Z,use_quota=True,user_id='816c9267240547d0a3900d292ef7a1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Creating volume 96deb872-af79-41a4-96e8-b17d6faff577 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:55 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-96deb872-af79-41a4-96e8-b17d6faff577 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fac7c23-3141-4630-90d3-9b935238ce2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1b9ef6-780e-4f00-a0d9-edd5f364821a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:55 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-96deb872-af79-41a4-96e8-b17d6faff577 1073741824
Apr 16 19:55:55 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:55 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1 (98ec9b81-52c3-424c-a4e6-aa2a072a9ff1): created successfully
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1b9ef6-780e-4f00-a0d9-edd5f364821a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Flow 'volume_create_manager' (f078f7d5-6325-43db-967e-2a082428aab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:55 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-06aaa126-c279-4f1e-b706-f4517a9d2fcb tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Created volume successfully.
Apr 16 19:55:55 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-986f6d9a-8c67-4494-ab52-fd8f43471974" returned: 0 in 0.493s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-quobyte-986f6d9a-8c67-4494-ab52-fd8f43471974" released by "delete_volume" :: held 0.978s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Created reservations ['8da03cd7-7dc5-4af2-b6d4-a0431c648803', '330a0408-50b4-45e6-ae94-66ef60a4a3c2', 'f383548f-7ad2-4ab8-ab0d-505658a2a7c2', 'bae4f9e7-0113-4eaf-b6ba-24f1dd5ce869'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:55 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-96deb872-af79-41a4-96e8-b17d6faff577 1073741824" returned: 0 in 0.518s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-96deb872-af79-41a4-96e8-b17d6faff577 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:55 devstack sudo[90786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-96deb872-af79-41a4-96e8-b17d6faff577
Apr 16 19:55:55 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:55 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:55 devstack sudo[90788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:55 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:56 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-96deb872-af79-41a4-96e8-b17d6faff577" returned: 0 in 0.419s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.164s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1888139982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c874e96-95b2-471d-8284-8aaca0afdd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939e6d3f814940a28b84c89ffc94fddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:44Z,use_quota=True,user_id='816c9267240547d0a3900d292ef7a1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Creating volume 6c874e96-95b2-471d-8284-8aaca0afdd53 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:56 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6c874e96-95b2-471d-8284-8aaca0afdd53 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:56 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5677ac1-b352-4e37-923f-dbc9b8cb4f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96deb872-af79-41a4-96e8-b17d6faff577', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2481ae64-adfb-442c-9983-c1c3b4b3262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:56 devstack sudo[90792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6c874e96-95b2-471d-8284-8aaca0afdd53 1073741824
Apr 16 19:55:56 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.429s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:56 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume volume-96deb872-af79-41a4-96e8-b17d6faff577 (96deb872-af79-41a4-96e8-b17d6faff577): created successfully
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2481ae64-adfb-442c-9983-c1c3b4b3262b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Flow 'volume_create_manager' (29efe713-1bfe-4bc7-bf4d-e9ae5b4e6b49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:56 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Deleted volume successfully.
Apr 16 19:55:56 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-b6c62e6c-7fce-46f0-98da-7ab678b7d25b tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Created volume successfully.
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0bb03070-36e9-4fdc-8ebc-27105abf7842 tempest-CreateVolumesFromImageTest-197169957 None] Lock "cinder-986f6d9a-8c67-4494-ab52-fd8f43471974-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:56 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6c874e96-95b2-471d-8284-8aaca0afdd53 1073741824" returned: 0 in 0.490s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:56 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6c874e96-95b2-471d-8284-8aaca0afdd53 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:56 devstack sudo[90797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6c874e96-95b2-471d-8284-8aaca0afdd53
Apr 16 19:55:56 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:57 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6c874e96-95b2-471d-8284-8aaca0afdd53" returned: 0 in 0.433s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.722s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-960200783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4dfcec-ef82-4b4a-902d-abc20601fd23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129a97b46a8a4cc4a819f7aa22d096e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:50Z,use_quota=True,user_id='721cc0860e764f349ed3f19b4f616d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Creating volume ee4dfcec-ef82-4b4a-902d-abc20601fd23 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:57 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236e4b3f-3e42-4a6c-802d-e94f39708d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c874e96-95b2-471d-8284-8aaca0afdd53', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5605078-99d0-43da-bd31-87b7d2f90c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:57 devstack sudo[90800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23 1073741824
Apr 16 19:55:57 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:57 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Volume volume-6c874e96-95b2-471d-8284-8aaca0afdd53 (6c874e96-95b2-471d-8284-8aaca0afdd53): created successfully
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5605078-99d0-43da-bd31-87b7d2f90c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Flow 'volume_create_manager' (0248e1ac-c4d2-4c02-b61f-b49796aa3b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:57 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c060c2dd-0c12-4a96-bda9-fdeab6c6f464 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Created volume successfully.
Apr 16 19:55:57 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23 1073741824" returned: 0 in 0.546s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:57 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:57 devstack sudo[90805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23
Apr 16 19:55:57 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "cinder-6c874e96-95b2-471d-8284-8aaca0afdd53-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-6c874e96-95b2-471d-8284-8aaca0afdd53-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "cinder-quobyte-6c874e96-95b2-471d-8284-8aaca0afdd53" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-quobyte-6c874e96-95b2-471d-8284-8aaca0afdd53" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5732e76-67ae-4073-ad22-b08dc0ebc69d]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6c874e96-95b2-471d-8284-8aaca0afdd53 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:58 devstack sudo[90807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6c874e96-95b2-471d-8284-8aaca0afdd53
Apr 16 19:55:58 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:58 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23" returned: 0 in 0.453s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.449s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-428433355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000f4629-8888-436b-a281-92d7fc8c64db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129a97b46a8a4cc4a819f7aa22d096e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:51Z,use_quota=True,user_id='721cc0860e764f349ed3f19b4f616d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Creating volume 000f4629-8888-436b-a281-92d7fc8c64db {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:58 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-000f4629-8888-436b-a281-92d7fc8c64db 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:58 devstack sudo[90810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-000f4629-8888-436b-a281-92d7fc8c64db 1073741824
Apr 16 19:55:58 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a33edbd-3200-451f-b237-4b88f8f6b3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5491d4-2d4e-4192-8284-a9bb21d0e6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:58 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23 (ee4dfcec-ef82-4b4a-902d-abc20601fd23): created successfully
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5491d4-2d4e-4192-8284-a9bb21d0e6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Flow 'volume_create_manager' (7308344c-e965-4356-8380-335391ac48b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:58 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-2e86964a-555c-40f3-b26d-6d337437e880 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Created volume successfully.
Apr 16 19:55:58 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6c874e96-95b2-471d-8284-8aaca0afdd53" returned: 0 in 0.579s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6c874e96-95b2-471d-8284-8aaca0afdd53 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:58 devstack sudo[90815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6c874e96-95b2-471d-8284-8aaca0afdd53
Apr 16 19:55:58 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:58 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-000f4629-8888-436b-a281-92d7fc8c64db 1073741824" returned: 0 in 0.581s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:58 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-000f4629-8888-436b-a281-92d7fc8c64db {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:58 devstack sudo[90820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-000f4629-8888-436b-a281-92d7fc8c64db
Apr 16 19:55:58 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:59 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-6c874e96-95b2-471d-8284-8aaca0afdd53" returned: 0 in 0.489s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-quobyte-6c874e96-95b2-471d-8284-8aaca0afdd53" released by "delete_volume" :: held 1.105s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Created reservations ['678cd927-8c3c-4b68-ab4e-9d4c8c9c4ce5', '8266c22d-d9b1-4964-bcd5-ff4a829571d9', 'a5debe70-6c7e-466b-9303-283b7379e9c2', '920a4a49-4548-4252-b561-2bb053e0a541'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:59 devstack sudo[90823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:55:59 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:59 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-000f4629-8888-436b-a281-92d7fc8c64db" returned: 0 in 0.458s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.413s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-383729451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef8cbf2-aea8-469b-8285-4ad5c3e08930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129a97b46a8a4cc4a819f7aa22d096e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:51Z,use_quota=True,user_id='721cc0860e764f349ed3f19b4f616d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Creating volume 0ef8cbf2-aea8-469b-8285-4ad5c3e08930 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:55:59 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c234fc30-0092-408f-aa3f-12a96b6cd5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-000f4629-8888-436b-a281-92d7fc8c64db', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ee8898-a8ae-4569-86a8-3834db480e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:55:59 devstack sudo[90826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930 1073741824
Apr 16 19:55:59 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:55:59 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume volume-000f4629-8888-436b-a281-92d7fc8c64db (000f4629-8888-436b-a281-92d7fc8c64db): created successfully
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ee8898-a8ae-4569-86a8-3834db480e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Flow 'volume_create_manager' (974e6fc8-903b-4f1b-aeff-f589c65f0184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:55:59 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-fc5ef59b-29d3-411f-b34f-2fa4a49035c8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Created volume successfully.
Apr 16 19:55:59 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.478s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:55:59 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Deleted volume successfully.
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-4b72c7fb-3aef-4f1f-9587-8ce8dbff8b08 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-6c874e96-95b2-471d-8284-8aaca0afdd53-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:55:59 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930 1073741824" returned: 0 in 0.564s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:55:59 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:00 devstack sudo[90832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930
Apr 16 19:56:00 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "cinder-96deb872-af79-41a4-96e8-b17d6faff577-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-96deb872-af79-41a4-96e8-b17d6faff577-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "cinder-quobyte-96deb872-af79-41a4-96e8-b17d6faff577" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-quobyte-96deb872-af79-41a4-96e8-b17d6faff577" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd95e92-881a-49e9-be18-45475efc2403]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-96deb872-af79-41a4-96e8-b17d6faff577 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:00 devstack sudo[90834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-96deb872-af79-41a4-96e8-b17d6faff577
Apr 16 19:56:00 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:00 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930" returned: 0 in 0.468s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.269s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-468742437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c123928b-9acd-4b3f-96f2-cac9b7e91378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129a97b46a8a4cc4a819f7aa22d096e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:51Z,use_quota=True,user_id='721cc0860e764f349ed3f19b4f616d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Creating volume c123928b-9acd-4b3f-96f2-cac9b7e91378 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:56:00 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c123928b-9acd-4b3f-96f2-cac9b7e91378 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd2a627-92f7-4de1-bec9-d77c27645a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae6e9e8-0a86-481d-b8f1-1736baf8962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:00 devstack sudo[90837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c123928b-9acd-4b3f-96f2-cac9b7e91378 1073741824
Apr 16 19:56:00 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:00 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930 (0ef8cbf2-aea8-469b-8285-4ad5c3e08930): created successfully
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae6e9e8-0a86-481d-b8f1-1736baf8962e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Flow 'volume_create_manager' (03fc0405-ec48-4761-9ea3-d0d2000ae601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:00 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ec7e22f3-75c4-417b-8f00-60d8d5356c74 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Created volume successfully.
Apr 16 19:56:00 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-96deb872-af79-41a4-96e8-b17d6faff577" returned: 0 in 0.537s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:00 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-96deb872-af79-41a4-96e8-b17d6faff577 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:00 devstack sudo[90844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-96deb872-af79-41a4-96e8-b17d6faff577
Apr 16 19:56:00 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:01 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c123928b-9acd-4b3f-96f2-cac9b7e91378 1073741824" returned: 0 in 0.619s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c123928b-9acd-4b3f-96f2-cac9b7e91378 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:01 devstack sudo[90849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c123928b-9acd-4b3f-96f2-cac9b7e91378
Apr 16 19:56:01 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:01 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-96deb872-af79-41a4-96e8-b17d6faff577" returned: 0 in 0.452s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-quobyte-96deb872-af79-41a4-96e8-b17d6faff577" released by "delete_volume" :: held 1.026s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Created reservations ['f1c282a2-cc14-40b9-bb72-0a4d56ea8e0d', '4e8795aa-fb45-4ed5-b406-ac45d357f3a1', '193b94d7-d9d4-4588-9ff5-c19272b68c99', '07c436fc-450e-4a8a-bcff-72f7c2596e32'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:01 devstack sudo[90852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:01 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:01 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c123928b-9acd-4b3f-96f2-cac9b7e91378" returned: 0 in 0.482s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.191s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1649676643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdbb652-9fea-4936-ab5a-96c2702ebecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129a97b46a8a4cc4a819f7aa22d096e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:55:51Z,use_quota=True,user_id='721cc0860e764f349ed3f19b4f616d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Creating volume fcdbb652-9fea-4936-ab5a-96c2702ebecd {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:56:01 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:01 devstack sudo[90855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd 1073741824
Apr 16 19:56:01 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c6cbaa-7d13-43ce-add6-a8ce443bb746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c123928b-9acd-4b3f-96f2-cac9b7e91378', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a882f3a-5c97-43db-9d81-11bc9e857834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:01 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume volume-c123928b-9acd-4b3f-96f2-cac9b7e91378 (c123928b-9acd-4b3f-96f2-cac9b7e91378): created successfully
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a882f3a-5c97-43db-9d81-11bc9e857834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Flow 'volume_create_manager' (c1b9913e-0314-443e-969e-93cfbea405f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:01 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a27223bc-b7df-4e78-bd8d-bb50ac941a05 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Created volume successfully.
Apr 16 19:56:01 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.536s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:01 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Deleted volume successfully.
Apr 16 19:56:01 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a146b962-82f1-44d2-aa1a-61f26fde22b5 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-96deb872-af79-41a4-96e8-b17d6faff577-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:02 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd 1073741824" returned: 0 in 0.608s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:02 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd
Apr 16 19:56:02 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "cinder-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "cinder-quobyte-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-quobyte-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1" acquired by "delete_volume" :: waited 0.022s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f480e2b9-af70-4a45-8afd-0a051834b002]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:02 devstack sudo[90863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1
Apr 16 19:56:02 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:02 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd" returned: 0 in 0.516s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.065s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-quobyte-3584a3e1-b549-466e-875a-d07d2e79f0db-10821c09-8749-4ab6-8c38-5dbc0661ecbe" by "_create_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0141ea-f406-42a1-8e70-231d05ec1d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a40a678-9914-4847-9ba5-5a2737067ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:02 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Volume volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd (fcdbb652-9fea-4936-ab5a-96c2702ebecd): created successfully
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a40a678-9914-4847-9ba5-5a2737067ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Flow 'volume_create_manager' (9af0af6b-9249-4751-9097-cec8994dd2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-3584a3e1-b549-466e-875a-d07d2e79f0db-10821c09-8749-4ab6-8c38-5dbc0661ecbe" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Creating volume 10821c09-8749-4ab6-8c38-5dbc0661ecbe from snapshot 3584a3e1-b549-466e-875a-d07d2e79f0db {{(pid=82616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-quobyte-10821c09-8749-4ab6-8c38-5dbc0661ecbe" by "_copy_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:02 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-c9b7762f-648a-4a0f-a6e5-4b2eed86a33c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Created volume successfully.
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-10821c09-8749-4ab6-8c38-5dbc0661ecbe" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] snapshot: 3584a3e1-b549-466e-875a-d07d2e79f0db, volume: 10821c09-8749-4ab6-8c38-5dbc0661ecbe,  {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2b863c-64ee-4988-9392-13dc95fa3250]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:02 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:02 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db
Apr 16 19:56:02 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:03 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1" returned: 0 in 0.690s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:03 devstack sudo[90871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1
Apr 16 19:56:03 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-fcdbb652-9fea-4936-ab5a-96c2702ebecd-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-fcdbb652-9fea-4936-ab5a-96c2702ebecd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-quobyte-fcdbb652-9fea-4936-ab5a-96c2702ebecd" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-fcdbb652-9fea-4936-ab5a-96c2702ebecd" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[88843e0f-cc58-4b8c-b8a1-e578acb11bc6]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:03 devstack sudo[90873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd
Apr 16 19:56:03 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:03 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db" returned: 0 in 0.697s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a117b84-46a6-4601-9b64-9cc801af2bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Creating direct copy from snapshot {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9bb453-7e31-4fa4-9c62-e506292941f6]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:03 devstack sudo[90878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef
Apr 16 19:56:03 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:03 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1" returned: 0 in 0.582s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-quobyte-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1" released by "delete_volume" :: held 1.296s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Created reservations ['ff7fe9c3-2cc2-4e19-8a52-07e748a475ea', '2ab4a43c-52d6-47d9-9f2f-f0d98507703e', '636a63e2-7990-4ff2-92f8-df3aeea8c386', 'c55c1b04-528c-416d-897a-ebd55aca00d1'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:03 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:03 devstack sudo[90882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:03 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:04 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd" returned: 0 in 0.742s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:04 devstack sudo[90916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd
Apr 16 19:56:04 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:04 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef" returned: 0 in 0.816s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG cinder.utils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Path /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe not found in is_blk_device check {{(pid=82616) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:04 devstack sudo[90925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe
Apr 16 19:56:04 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:04 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.806s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:04 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Deleted volume successfully.
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "cinder-2554149e-1d18-4d5b-8d45-45e946cbd85d-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-35cd7f29-698e-44d3-91c5-1642429a4e84 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-98ec9b81-52c3-424c-a4e6-aa2a072a9ff1-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-2554149e-1d18-4d5b-8d45-45e946cbd85d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:04 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-fcdbb652-9fea-4936-ab5a-96c2702ebecd" returned: 0 in 0.614s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-fcdbb652-9fea-4936-ab5a-96c2702ebecd" released by "delete_volume" :: held 1.385s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "cinder-quobyte-2554149e-1d18-4d5b-8d45-45e946cbd85d" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-quobyte-2554149e-1d18-4d5b-8d45-45e946cbd85d" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ede8bb1-86aa-41f3-b086-a95da3919da2]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2554149e-1d18-4d5b-8d45-45e946cbd85d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Created reservations ['030fbe65-f1c1-439b-8ba1-9a046cade3f8', 'bbe06c08-dee2-49d5-ad69-a9a725a175af', '9b519996-2081-4898-bc8a-774ea8b44882', 'aaa2d393-34b5-49bc-8218-c155752dbd68'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:04 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:04 devstack sudo[90931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:04 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:04 devstack sudo[90930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2554149e-1d18-4d5b-8d45-45e946cbd85d
Apr 16 19:56:04 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:05 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-c123928b-9acd-4b3f-96f2-cac9b7e91378-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:05 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-c123928b-9acd-4b3f-96f2-cac9b7e91378-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:05 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-quobyte-c123928b-9acd-4b3f-96f2-cac9b7e91378" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:05 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2554149e-1d18-4d5b-8d45-45e946cbd85d" returned: 0 in 1.194s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:05 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2554149e-1d18-4d5b-8d45-45e946cbd85d {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-c123928b-9acd-4b3f-96f2-cac9b7e91378" acquired by "delete_volume" :: waited 0.073s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:06 devstack sudo[90948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2554149e-1d18-4d5b-8d45-45e946cbd85d
Apr 16 19:56:06 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:06 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e648a16c-de5f-44a4-8ec8-23bd1a3b1f3c]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c123928b-9acd-4b3f-96f2-cac9b7e91378 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:06 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:06 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 1.717s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:06 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:06 devstack sudo[90950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c123928b-9acd-4b3f-96f2-cac9b7e91378
Apr 16 19:56:06 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:06 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Deleted volume successfully.
Apr 16 19:56:06 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7e14b8ee-fe1a-4618-81cd-f5f07b4e3f44 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-fcdbb652-9fea-4936-ab5a-96c2702ebecd-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:07 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-2554149e-1d18-4d5b-8d45-45e946cbd85d" returned: 0 in 1.384s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-quobyte-2554149e-1d18-4d5b-8d45-45e946cbd85d" released by "delete_volume" :: held 2.603s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:07 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe" returned: 0 in 2.972s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc2d74b-32ea-4782-8bb8-49b48fa277f9]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Created reservations ['00e71cca-29f1-4616-b182-8c9289c5b944', '37b431e8-5a4b-46c9-b489-767621ccff22', '72bb6469-489a-4a77-b289-7fea3e326208', '2b5c0adc-4fdd-452b-8fdb-5f36d09d3bd9'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:07 devstack sudo[90953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef
Apr 16 19:56:07 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:07 devstack sudo[90954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:07 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:07 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c123928b-9acd-4b3f-96f2-cac9b7e91378" returned: 0 in 1.553s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c123928b-9acd-4b3f-96f2-cac9b7e91378 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:07 devstack sudo[90960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c123928b-9acd-4b3f-96f2-cac9b7e91378
Apr 16 19:56:07 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:07 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.503s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:07 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Deleted volume successfully.
Apr 16 19:56:07 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-d5fd8358-94c1-4c4a-a28b-6f7fcf3da072 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-2554149e-1d18-4d5b-8d45-45e946cbd85d-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:08 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef" returned: 0 in 0.672s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef, size 1024.00 MB, duration 2.98 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:56:08 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Converted 1024.00 MB image at 344.11 MB/s
Apr 16 19:56:08 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe is being set with open permissions: ugo+rw
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:08 devstack sudo[90967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe
Apr 16 19:56:08 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:08 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c123928b-9acd-4b3f-96f2-cac9b7e91378" returned: 0 in 0.512s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-c123928b-9acd-4b3f-96f2-cac9b7e91378" released by "delete_volume" :: held 2.120s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Created reservations ['8448ce7c-2d43-4863-9691-363b3f51b9f0', '9f15fcd5-2d50-4a0f-95fd-268719526495', '72889812-fc3a-458f-a6c8-a271e6a456b1', '255ca818-8a11-40d2-abcf-c7d5eea95ce3'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:08 devstack sudo[90971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:08 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-0ef8cbf2-aea8-469b-8285-4ad5c3e08930-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-0ef8cbf2-aea8-469b-8285-4ad5c3e08930-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-quobyte-0ef8cbf2-aea8-469b-8285-4ad5c3e08930" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-0ef8cbf2-aea8-469b-8285-4ad5c3e08930" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "cinder-41031d80-0bb7-456f-a90a-c6210f5ec2b8-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a9c671-d526-45d4-9eec-00a0383db774]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-41031d80-0bb7-456f-a90a-c6210f5ec2b8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "cinder-quobyte-41031d80-0bb7-456f-a90a-c6210f5ec2b8" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:08 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930
Apr 16 19:56:08 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-quobyte-41031d80-0bb7-456f-a90a-c6210f5ec2b8" acquired by "delete_volume" :: waited 0.023s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a6e767-132b-4fe6-b84e-d238ebeaea19]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:08 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe" returned: 0 in 0.619s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-10821c09-8749-4ab6-8c38-5dbc0661ecbe" released by "_copy_volume_from_snapshot" :: held 5.885s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-3584a3e1-b549-466e-875a-d07d2e79f0db-10821c09-8749-4ab6-8c38-5dbc0661ecbe" released by "_create_volume_from_snapshot" :: held 5.908s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.947s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:08 devstack sudo[90976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8
Apr 16 19:56:08 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25942748-4f72-4df0-a6e4-d343aabfb46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe', 'volume_size': 1, 'snapshot_id': '3584a3e1-b549-466e-875a-d07d2e79f0db'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de954756-2c1b-40bd-8de0-95599ce91076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:08 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Volume volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe (10821c09-8749-4ab6-8c38-5dbc0661ecbe): created successfully
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de954756-2c1b-40bd-8de0-95599ce91076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Flow 'volume_create_manager' (3f1aa809-bca6-4c5d-a1c8-653c5d6f64fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:08 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-779ff941-9dbb-4a2d-a342-406e54185619 tempest-VolumeDependencyTests-661061709 None] Created volume successfully.
Apr 16 19:56:08 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.679s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:08 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Deleted volume successfully.
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-1be2749e-0c7a-42cf-97a3-c60b8a8e4134 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-c123928b-9acd-4b3f-96f2-cac9b7e91378-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:08 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930" returned: 0 in 0.587s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:08 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:09 devstack sudo[90982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930
Apr 16 19:56:09 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:09 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8" returned: 0 in 0.688s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:09 devstack sudo[90987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8
Apr 16 19:56:09 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:09 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-0ef8cbf2-aea8-469b-8285-4ad5c3e08930" returned: 0 in 0.472s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-0ef8cbf2-aea8-469b-8285-4ad5c3e08930" released by "delete_volume" :: held 1.114s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Created reservations ['de35e724-8300-4b41-8a07-f23ab637518f', '9bad1aba-5208-4dc7-af9b-02df19bd59f0', '929d8d31-875b-4164-ab59-e8e3cbf434e1', 'd677ce57-e42e-4f9a-a490-601c64558fd5'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:09 devstack sudo[90990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:09 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-3584a3e1-b549-466e-875a-d07d2e79f0db-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-3584a3e1-b549-466e-875a-d07d2e79f0db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-quobyte-3a117b84-46a6-4601-9b64-9cc801af2bef" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-3a117b84-46a6-4601-9b64-9cc801af2bef" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-quobyte-3584a3e1-b549-466e-875a-d07d2e79f0db" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-3584a3e1-b549-466e-875a-d07d2e79f0db" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Deleting offline snapshot 3584a3e1-b549-466e-875a-d07d2e79f0db of volume 3a117b84-46a6-4601-9b64-9cc801af2bef {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] snapshot_file for this snap is: volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3f3bf2-7245-42d1-bdf5-7c491cebd52a]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:09 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:09 devstack sudo[90992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db
Apr 16 19:56:09 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-41031d80-0bb7-456f-a90a-c6210f5ec2b8" returned: 0 in 0.633s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-quobyte-41031d80-0bb7-456f-a90a-c6210f5ec2b8" released by "delete_volume" :: held 1.353s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Created reservations ['bb6806ea-0871-47ee-aa56-52e2aab51d4c', '84125101-1fb0-4560-a717-8e4256d15307', 'be6e68c7-8152-420d-aac7-a9e10dd383ae', 'b9380be1-6e2e-4e56-a51c-df0fd366cb38'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:09 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:10 devstack sudo[90995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:10 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:10 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.614s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:10 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Deleted volume successfully.
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-65229594-0afe-4742-bd27-8bc9a08c6ff8 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-0ef8cbf2-aea8-469b-8285-4ad5c3e08930-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:10 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db" returned: 0 in 0.617s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a117b84-46a6-4601-9b64-9cc801af2bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd53677-e044-41a7-8610-e60c5b818676]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:10 devstack sudo[91001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef
Apr 16 19:56:10 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:10 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.525s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:10 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Deleted volume successfully.
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-a7583be5-010f-40b3-aecc-b3b4450d09a3 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-41031d80-0bb7-456f-a90a-c6210f5ec2b8-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-000f4629-8888-436b-a281-92d7fc8c64db-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-000f4629-8888-436b-a281-92d7fc8c64db-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-quobyte-000f4629-8888-436b-a281-92d7fc8c64db" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-000f4629-8888-436b-a281-92d7fc8c64db" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "cinder-a463c744-7a7c-49a1-8fef-547ea3c5d72e-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[31574dd5-a612-48bc-a517-8d81f434a8c7]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-000f4629-8888-436b-a281-92d7fc8c64db {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-a463c744-7a7c-49a1-8fef-547ea3c5d72e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "cinder-quobyte-a463c744-7a7c-49a1-8fef-547ea3c5d72e" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-quobyte-a463c744-7a7c-49a1-8fef-547ea3c5d72e" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c24db0-7ed8-4d10-aea5-bc5261898460]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:10 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:10 devstack sudo[91004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-000f4629-8888-436b-a281-92d7fc8c64db
Apr 16 19:56:10 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:10 devstack sudo[91005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e
Apr 16 19:56:10 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:11 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef" returned: 0 in 0.626s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:11 devstack sudo[91011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db
Apr 16 19:56:11 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:11 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-000f4629-8888-436b-a281-92d7fc8c64db" returned: 0 in 0.523s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-000f4629-8888-436b-a281-92d7fc8c64db {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:11 devstack sudo[91019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-000f4629-8888-436b-a281-92d7fc8c64db
Apr 16 19:56:11 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:11 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e" returned: 0 in 0.559s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:11 devstack sudo[91021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e
Apr 16 19:56:11 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_service.periodic_task [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82616) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:11 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db" returned: 0 in 0.550s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:11 devstack sudo[91026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:11 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:11 devstack sudo[91028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db
Apr 16 19:56:11 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:11 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-000f4629-8888-436b-a281-92d7fc8c64db" returned: 0 in 0.673s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-000f4629-8888-436b-a281-92d7fc8c64db" released by "delete_volume" :: held 1.233s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:11 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Created reservations ['adf06a10-edfb-42ee-a8ad-74285406c15d', '2c6dcbb6-5d1b-44b7-aa2c-b710620423cd', 'afa20df0-f7da-4afe-a814-897b01ae5525', '344b9548-5ffc-4c35-bedb-d4345446a364'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:12 devstack sudo[91032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:12 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:12 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-a463c744-7a7c-49a1-8fef-547ea3c5d72e" returned: 0 in 0.761s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-quobyte-a463c744-7a7c-49a1-8fef-547ea3c5d72e" released by "delete_volume" :: held 1.344s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Created reservations ['21fcada5-80f9-4b38-a6e9-aa5995a2570e', '8ea61125-901c-418c-85ba-7558ea949188', '30e3702e-425c-47dc-a25e-b51df2bd391e', 'cab6d4d0-1789-418e-b1b6-8ba681921cec'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:12 devstack sudo[91035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:12 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:12 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef.3584a3e1-b549-466e-875a-d07d2e79f0db" returned: 0 in 0.652s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-3584a3e1-b549-466e-875a-d07d2e79f0db" released by "_delete_snapshot" :: held 2.517s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-3a117b84-46a6-4601-9b64-9cc801af2bef" released by "delete_snapshot" :: held 2.540s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Created reservations ['b78e539f-35e9-4aa2-b226-b10c95f15d3d', '09cb8e2a-2225-419e-ab5c-a60a061c3311', '8127bc6e-653e-4ed8-8892-2eea079bf6de', 'f18dc77a-e90f-4c1f-a628-a7290c8f091b'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:12 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Delete snapshot completed successfully.
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-76a41412-44b1-4930-9d20-be01424bb7c9 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-3584a3e1-b549-466e-875a-d07d2e79f0db-delete_snapshot" released by "delete_snapshot" :: held 2.630s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:12 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.808s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-cab362de-66ef-43fb-97ce-4a38dc66b390 None None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:12 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.658s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:12 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Deleted volume successfully.
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7c21a582-ab70-4781-a779-02559d846ee5 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-000f4629-8888-436b-a281-92d7fc8c64db-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:12 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.585s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:12 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Deleted volume successfully.
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-0d65d591-cd83-4409-bd93-8c42c5179907 tempest-CreateVolumesFromSourceVolumeTest-1477639826 None] Lock "cinder-a463c744-7a7c-49a1-8fef-547ea3c5d72e-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-ee4dfcec-ef82-4b4a-902d-abc20601fd23-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-ee4dfcec-ef82-4b4a-902d-abc20601fd23-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-quobyte-ee4dfcec-ef82-4b4a-902d-abc20601fd23" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-ee4dfcec-ef82-4b4a-902d-abc20601fd23" acquired by "delete_volume" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d84df5-5448-495b-ae70-ac52f6bd94a6]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-3a117b84-46a6-4601-9b64-9cc801af2bef-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-3a117b84-46a6-4601-9b64-9cc801af2bef-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-quobyte-3a117b84-46a6-4601-9b64-9cc801af2bef" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:12 devstack sudo[91040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23
Apr 16 19:56:12 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:12 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-3a117b84-46a6-4601-9b64-9cc801af2bef" acquired by "delete_volume" :: waited 0.018s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:13 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b76ddec-3e67-4ffe-ad8c-43f823780889]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:13 devstack sudo[91042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef
Apr 16 19:56:13 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:13 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23" returned: 0 in 0.581s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:13 devstack sudo[91047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23
Apr 16 19:56:13 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:13 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef" returned: 0 in 0.743s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:13 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:13 devstack sudo[91052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef
Apr 16 19:56:13 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:14 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-ee4dfcec-ef82-4b4a-902d-abc20601fd23" returned: 0 in 0.570s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-ee4dfcec-ef82-4b4a-902d-abc20601fd23" released by "delete_volume" :: held 1.189s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Created reservations ['eddb454e-9d4d-4273-abed-69ea8e36cc27', '2d1b2e63-68c7-47df-8d82-dd0338c1af71', 'c3f60b2b-cfa3-4f8e-aef7-aad4b955905f', '68b96ea8-13a0-4a1f-a773-59c0a68a9c7d'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:14 devstack sudo[91055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:14 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:14 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-3a117b84-46a6-4601-9b64-9cc801af2bef" returned: 0 in 0.604s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-3a117b84-46a6-4601-9b64-9cc801af2bef" released by "delete_volume" :: held 1.399s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Created reservations ['1edda5d9-0ded-410c-8676-7143a9797219', '1d906ac6-42a1-4394-a06f-e1c3a790779e', '7312d29d-5db7-4e5a-865d-5d09e1e7d7d6', '3c98d442-85d0-4327-9bfc-83555e1d1879'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:14 devstack sudo[91058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:14 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:14 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.539s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:14 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Deleted volume successfully.
Apr 16 19:56:14 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-215ab1ad-2e2d-443b-be94-e343d0c521c6 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-ee4dfcec-ef82-4b4a-902d-abc20601fd23-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-0482652f-9213-4ed8-a802-4f35fcaeb7eb-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-0482652f-9213-4ed8-a802-4f35fcaeb7eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-quobyte-291a294f-9757-4fa0-a09e-77b412169d5c" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-291a294f-9757-4fa0-a09e-77b412169d5c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-quobyte-0482652f-9213-4ed8-a802-4f35fcaeb7eb" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-0482652f-9213-4ed8-a802-4f35fcaeb7eb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Deleting offline snapshot 0482652f-9213-4ed8-a802-4f35fcaeb7eb of volume 291a294f-9757-4fa0-a09e-77b412169d5c {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] snapshot_file for this snap is: volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f862a50-7029-4368-9173-4b3e45682841]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:15 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.625s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:15 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Deleted volume successfully.
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8fccb210-e9b8-4809-b9dd-fef76dc9bc17 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-3a117b84-46a6-4601-9b64-9cc801af2bef-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:15 devstack sudo[91063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb
Apr 16 19:56:15 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Flow 'volume_create_manager' (71b5136e-e97a-424f-a3e4-38d9cf86dd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9e125d-3a48-4e81-aa57-56d7aa052b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9e125d-3a48-4e81-aa57-56d7aa052b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19fa4ec9-5c89-4dd8-b9de-caed000c3b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cff310ceaed4d1fbcaad8b0c7529d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:56:15Z,use_quota=True,user_id='902a3115ceb045e6a04e22969e097cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caefcb5a-2fc8-4ca8-825c-8aabff92fe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caefcb5a-2fc8-4ca8-825c-8aabff92fe4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfcbc8cb-4da9-4e1a-bd6f-342feed146f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfcbc8cb-4da9-4e1a-bd6f-342feed146f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19fa4ec9-5c89-4dd8-b9de-caed000c3b90', 'volume_name': 'volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cbc3b4-751b-4857-adb8-6bdf2ab53c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cbc3b4-751b-4857-adb8-6bdf2ab53c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc6b720-e4d5-4a51-bda4-9451382bb3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:15 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Volume 19fa4ec9-5c89-4dd8-b9de-caed000c3b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90', 'volume_size': 1}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19fa4ec9-5c89-4dd8-b9de-caed000c3b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cff310ceaed4d1fbcaad8b0c7529d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:56:15Z,use_quota=True,user_id='902a3115ceb045e6a04e22969e097cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Creating volume 19fa4ec9-5c89-4dd8-b9de-caed000c3b90 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:56:15 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Flow 'volume_create_manager' (5f012fce-7582-44c1-a0ab-7f949187bd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:15 devstack sudo[91065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90 1073741824
Apr 16 19:56:15 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a39dd5-1883-4c53-9f8b-01ed50347c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a39dd5-1883-4c53-9f8b-01ed50347c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-520078170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba793be-bc79-4641-b03e-54b2a8631160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77f0d4c5da9411a88a90dec9fa63749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:56:15Z,use_quota=True,user_id='5ec065e5e9444b8091285a6753525163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5898dfcf-e34f-443e-970f-c78e1fba87fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5898dfcf-e34f-443e-970f-c78e1fba87fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128606fd-854e-486f-8554-8c9684c9e751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128606fd-854e-486f-8554-8c9684c9e751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cba793be-bc79-4641-b03e-54b2a8631160', 'volume_name': 'volume-cba793be-bc79-4641-b03e-54b2a8631160', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e6dfae-f2a6-42bc-b3a5-84675454a014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e6dfae-f2a6-42bc-b3a5-84675454a014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072d2135-c0ff-4a77-96ec-8fabe14792f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:15 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Volume cba793be-bc79-4641-b03e-54b2a8631160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cba793be-bc79-4641-b03e-54b2a8631160', 'volume_size': 1}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:15 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb" returned: 0 in 0.612s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-291a294f-9757-4fa0-a09e-77b412169d5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8664b20e-f059-478f-8e3d-cdb71884a85c]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:15 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:15 devstack sudo[91070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c
Apr 16 19:56:15 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:16 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90 1073741824" returned: 0 in 0.733s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:16 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:16 devstack sudo[91078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90
Apr 16 19:56:16 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c" returned: 0 in 0.588s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:16 devstack sudo[91080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb
Apr 16 19:56:16 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:16 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90" returned: 0 in 0.444s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-520078170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba793be-bc79-4641-b03e-54b2a8631160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77f0d4c5da9411a88a90dec9fa63749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:56:15Z,use_quota=True,user_id='5ec065e5e9444b8091285a6753525163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Creating volume cba793be-bc79-4641-b03e-54b2a8631160 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:56:16 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:16 devstack sudo[91086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 1073741824
Apr 16 19:56:16 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc6b720-e4d5-4a51-bda4-9451382bb3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609f371a-e614-4fe2-894e-7d631fcd589b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Flow 'volume_create_manager' (eed7e391-6cc2-44b7-b41d-371ebe810119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c69a8f-aa80-4262-b785-dd07bf4915ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c69a8f-aa80-4262-b785-dd07bf4915ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1776333160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fd73e2-2904-4ce1-a47b-e2499bc07461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6cbc11b0004b6eb9cda918451e74ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:56:17Z,use_quota=True,user_id='85539614ab874d4dbdf95f039123fd99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3b4bcb-77c2-4afe-bdd9-4917ae0e9513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3b4bcb-77c2-4afe-bdd9-4917ae0e9513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e717d0-e564-499a-b4d3-a6872120bc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e717d0-e564-499a-b4d3-a6872120bc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69fd73e2-2904-4ce1-a47b-e2499bc07461', 'volume_name': 'volume-69fd73e2-2904-4ce1-a47b-e2499bc07461', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59dc793-a99f-47d6-8391-248d8b3581f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59dc793-a99f-47d6-8391-248d8b3581f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c247e6-5f43-48d7-9fa9-ece7615975a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:16 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Volume 69fd73e2-2904-4ce1-a47b-e2499bc07461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69fd73e2-2904-4ce1-a47b-e2499bc07461', 'volume_size': 1}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:16 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Volume volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90 (19fa4ec9-5c89-4dd8-b9de-caed000c3b90): created successfully
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609f371a-e614-4fe2-894e-7d631fcd589b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Flow 'volume_create_manager' (71b5136e-e97a-424f-a3e4-38d9cf86dd50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:16 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:16 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-93f65aec-f828-4c49-ab7d-200e19892b28 tempest-CinderUnicodeTest-2000663133 None] Created volume successfully.
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb" returned: 0 in 0.561s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:16 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:16 devstack sudo[91088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb
Apr 16 19:56:16 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:17 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 1073741824" returned: 0 in 0.537s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:17 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c.0482652f-9213-4ed8-a802-4f35fcaeb7eb" returned: 0 in 0.450s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:17 devstack sudo[91095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160
Apr 16 19:56:17 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-0482652f-9213-4ed8-a802-4f35fcaeb7eb" released by "_delete_snapshot" :: held 2.276s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-291a294f-9757-4fa0-a09e-77b412169d5c" released by "delete_snapshot" :: held 2.296s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Created reservations ['a35b7dd2-cd8c-44b3-8a37-9dd6b1ef35c4', '79380566-12e3-4ecd-a4f1-70cdeb4de211', 'd0d9932d-2f83-4f17-bfc8-b13b22780593', '261dfaca-75ab-4ea8-b5a2-8d840227d6f5'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:17 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Delete snapshot completed successfully.
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-50dc449d-5af1-45bd-b948-fbcc4a92391c tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-0482652f-9213-4ed8-a802-4f35fcaeb7eb-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Flow 'volume_create_manager' (f9466b9e-c596-4c76-b078-3b81a0ab9ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:17 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f69be31-9128-4199-bbd0-290f8941c0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160" returned: 0 in 0.475s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.935s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1776333160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fd73e2-2904-4ce1-a47b-e2499bc07461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6cbc11b0004b6eb9cda918451e74ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:56:17Z,use_quota=True,user_id='85539614ab874d4dbdf95f039123fd99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Creating volume 69fd73e2-2904-4ce1-a47b-e2499bc07461 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:56:17 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f69be31-9128-4199-bbd0-290f8941c0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:56:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2040462108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5649d11c-8675-44f7-943c-e551efdadb34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cff310ceaed4d1fbcaad8b0c7529d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:56:18Z,use_quota=True,user_id='902a3115ceb045e6a04e22969e097cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:17 devstack sudo[91098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 1073741824
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e230c8e-e527-4eca-83f2-0b2014914dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:17 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e230c8e-e527-4eca-83f2-0b2014914dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b035aeb7-4338-4bf6-9122-acee1d60b303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b035aeb7-4338-4bf6-9122-acee1d60b303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5649d11c-8675-44f7-943c-e551efdadb34', 'volume_name': 'volume-5649d11c-8675-44f7-943c-e551efdadb34', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98530f1-3fe3-4e9f-a203-4462102dd01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98530f1-3fe3-4e9f-a203-4462102dd01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61abfdf-36a2-4a3a-a303-0aa118ac9c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:17 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Volume 5649d11c-8675-44f7-943c-e551efdadb34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5649d11c-8675-44f7-943c-e551efdadb34', 'volume_size': 1}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072d2135-c0ff-4a77-96ec-8fabe14792f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cba793be-bc79-4641-b03e-54b2a8631160', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb14dcc-2dcb-457e-8146-2efbaf44711a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:17 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Volume volume-cba793be-bc79-4641-b03e-54b2a8631160 (cba793be-bc79-4641-b03e-54b2a8631160): created successfully
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb14dcc-2dcb-457e-8146-2efbaf44711a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:17 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Flow 'volume_create_manager' (5f012fce-7582-44c1-a0ab-7f949187bd1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:17 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-111c44d0-7dce-43ee-9c06-a576ad1838ae tempest-VolumeDependencyTests-661061709 None] Created volume successfully.
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-291a294f-9757-4fa0-a09e-77b412169d5c-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-291a294f-9757-4fa0-a09e-77b412169d5c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "cinder-quobyte-291a294f-9757-4fa0-a09e-77b412169d5c" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-291a294f-9757-4fa0-a09e-77b412169d5c" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b83b40-f0d5-4359-956a-27e1089998cf]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:18 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 1073741824" returned: 0 in 0.558s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:18 devstack sudo[91103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c
Apr 16 19:56:18 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:18 devstack sudo[91105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461
Apr 16 19:56:18 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:18 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c" returned: 0 in 0.540s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:18 devstack sudo[91111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c
Apr 16 19:56:18 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:18 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461" returned: 0 in 0.547s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.092s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa36383e3e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:56:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2040462108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5649d11c-8675-44f7-943c-e551efdadb34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cff310ceaed4d1fbcaad8b0c7529d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:56:18Z,use_quota=True,user_id='902a3115ceb045e6a04e22969e097cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)}" {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Creating volume 5649d11c-8675-44f7-943c-e551efdadb34 {{(pid=82616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:56:18 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] casted to osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34 1073741824 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c247e6-5f43-48d7-9fa9-ece7615975a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69fd73e2-2904-4ce1-a47b-e2499bc07461', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efeb74bf-c1b3-4b6a-99f0-a5fd03dfc5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:18 devstack sudo[91113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34 1073741824
Apr 16 19:56:18 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:18 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:56:18 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Volume volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 (69fd73e2-2904-4ce1-a47b-e2499bc07461): created successfully
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efeb74bf-c1b3-4b6a-99f0-a5fd03dfc5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Flow 'volume_create_manager' (eed7e391-6cc2-44b7-b41d-371ebe810119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Flow 'volume_create_manager' (03aa7ee8-69fb-4ee5-9b74-6d02bb16267f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0468bb26-0297-490c-aee7-a1f3714cc7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0468bb26-0297-490c-aee7-a1f3714cc7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-82432024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c548752f-cc39-4b65-b4ce-a82965a98822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77f0d4c5da9411a88a90dec9fa63749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=cba793be-bc79-4641-b03e-54b2a8631160,status='creating',terminated_at=None,updated_at=2026-04-16T17:56:19Z,use_quota=True,user_id='5ec065e5e9444b8091285a6753525163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185b0c8d-7322-4763-8236-6bbf2d78c89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185b0c8d-7322-4763-8236-6bbf2d78c89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce4b1c7-a459-4859-9eaf-1a40fd56bf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:19 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-b65b4a7e-ac01-4eba-9e8a-f6649b0ebe53 tempest-SnapshotDependencyTests-2035122597 None] Created volume successfully.
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce4b1c7-a459-4859-9eaf-1a40fd56bf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c548752f-cc39-4b65-b4ce-a82965a98822', 'volume_name': 'volume-c548752f-cc39-4b65-b4ce-a82965a98822', 'volume_size': 1, 'source_volid': 'cba793be-bc79-4641-b03e-54b2a8631160', 'source_volstatus': 'available'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8ed56d-03fd-4f7d-8249-cbbd23bbd086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8ed56d-03fd-4f7d-8249-cbbd23bbd086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f39fbe-6188-4785-8850-1022b2be87d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:19 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Volume c548752f-cc39-4b65-b4ce-a82965a98822: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c548752f-cc39-4b65-b4ce-a82965a98822', 'volume_size': 1, 'source_volid': 'cba793be-bc79-4641-b03e-54b2a8631160', 'source_volstatus': 'available'}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:19 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-291a294f-9757-4fa0-a09e-77b412169d5c" returned: 0 in 0.471s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-quobyte-291a294f-9757-4fa0-a09e-77b412169d5c" released by "delete_volume" :: held 1.045s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Created reservations ['dea58116-67b3-4c6b-bcc1-700565548fca', 'a67729cf-8237-495a-b5ee-f1a65c0b3478', '08de5591-8028-4bc6-965b-d3af4a038d6c', 'f4c6df6b-19e5-45b5-8cee-587f49a24a21'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:19 devstack sudo[91119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:19 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:19 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34 1073741824" returned: 0 in 0.529s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:19 devstack sudo[91121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34
Apr 16 19:56:19 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:19 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.437s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:19 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Deleted volume successfully.
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-31b3ba40-487a-4672-8db0-fe5fe8487c16 tempest-CreateVolumesFromSnapshotTest-2110859824 None] Lock "cinder-291a294f-9757-4fa0-a09e-77b412169d5c-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:19 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34" returned: 0 in 0.442s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'} {{(pid=82616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.865s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:19 devstack cinder-volume[82616]: INFO cinder.volume.drivers.remotefs [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Cloning volume cba793be-bc79-4641-b03e-54b2a8631160 to volume c548752f-cc39-4b65-b4ce-a82965a98822
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61abfdf-36a2-4a3a-a303-0aa118ac9c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5649d11c-8675-44f7-943c-e551efdadb34', 'volume_size': 1}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34af8ba-c826-4dc9-9d27-e497b943a32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:19 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Volume volume-5649d11c-8675-44f7-943c-e551efdadb34 (5649d11c-8675-44f7-943c-e551efdadb34): created successfully
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34af8ba-c826-4dc9-9d27-e497b943a32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:19 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Flow 'volume_create_manager' (f9466b9e-c596-4c76-b078-3b81a0ab9ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:20 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Creating offline snapshot 5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b of volume cba793be-bc79-4641-b03e-54b2a8631160 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:56:20 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-4dd75d3f-3df4-4b9d-8321-3d8a28f7eb8a tempest-CinderUnicodeTest-2000663133 None] Created volume successfully.
Apr 16 19:56:20 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1754d104-1e6d-4386-acc6-777de69dc28c]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:20 devstack sudo[91125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160
Apr 16 19:56:20 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:20 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160" returned: 0 in 0.520s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:20 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:20 devstack sudo[91130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b 1G
Apr 16 19:56:20 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:21 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b 1G" returned: 0 in 0.583s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cba793be-bc79-4641-b03e-54b2a8631160 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:21 devstack sudo[91135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cba793be-bc79-4641-b03e-54b2a8631160 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b
Apr 16 19:56:21 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:21 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cba793be-bc79-4641-b03e-54b2a8631160 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b" returned: 0 in 0.468s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:21 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b is being set with open permissions: ugo+rw
Apr 16 19:56:21 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:21 devstack sudo[91140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b
Apr 16 19:56:21 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:22 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b" returned: 0 in 0.417s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:22 devstack sudo[91143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.info
Apr 16 19:56:22 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:22 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.info" returned: 0 in 0.413s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:22 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.info is being set with open permissions: ugo+rw
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:22 devstack sudo[91146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.info
Apr 16 19:56:22 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:22 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.info" returned: 0 in 0.410s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-quobyte-c548752f-cc39-4b65-b4ce-a82965a98822" by "_copy_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-c548752f-cc39-4b65-b4ce-a82965a98822" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] snapshot: 5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b, volume: c548752f-cc39-4b65-b4ce-a82965a98822,  {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[028291d3-a380-49f6-9e24-659b79225a93]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:22 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:22 devstack sudo[91149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b
Apr 16 19:56:22 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:23 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b" returned: 0 in 0.491s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cba793be-bc79-4641-b03e-54b2a8631160(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:56:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 19:56:23 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Creating direct copy from snapshot {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 19:56:23 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb9f325-3203-4a8d-9518-6065d5717634]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:23 devstack sudo[91154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160
Apr 16 19:56:23 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:23 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160" returned: 0 in 0.479s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:23 devstack cinder-volume[82616]: DEBUG cinder.utils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Path /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822 not found in is_blk_device check {{(pid=82616) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 19:56:23 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:23 devstack sudo[91159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822
Apr 16 19:56:23 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:25 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822" returned: 0 in 2.021s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:25 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ead853-8c86-4cd6-9b31-12dd2ab68446]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:25 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:25 devstack sudo[91172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160
Apr 16 19:56:25 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:26 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160" returned: 0 in 0.598s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:26 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:56:26 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Converted 1024.00 MB image at 506.31 MB/s
Apr 16 19:56:26 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822 is being set with open permissions: ugo+rw
Apr 16 19:56:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:26 devstack sudo[91177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822
Apr 16 19:56:26 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:26 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822" returned: 0 in 0.434s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-c548752f-cc39-4b65-b4ce-a82965a98822" released by "_copy_volume_from_snapshot" :: held 4.072s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:26 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:UPDATE=276,cinder:SELECT=204,cinder:DELETE=23,cinder:INSERT=71 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:56:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-quobyte-5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:26 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Deleting offline snapshot 5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b of volume cba793be-bc79-4641-b03e-54b2a8631160 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:56:26 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] snapshot_file for this snap is: volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:56:26 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[614764bb-aaa7-49bb-99a1-529e6db0c792]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:26 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:27 devstack sudo[91180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b
Apr 16 19:56:27 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:27 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b" returned: 0 in 0.476s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:27 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cba793be-bc79-4641-b03e-54b2a8631160(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:56:27 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb05f35-6e13-4317-b722-85821450d656]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:27 devstack sudo[91185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160
Apr 16 19:56:27 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:27 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160" returned: 0 in 0.468s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:27 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:27 devstack sudo[91190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b
Apr 16 19:56:27 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:28 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b" returned: 0 in 0.465s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:28 devstack sudo[91195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b
Apr 16 19:56:28 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:28 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160.5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b" returned: 0 in 0.426s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-5a296d52-ec36-4ed6-9d03-e0efdbc4ac4b" released by "_delete_snapshot" :: held 1.881s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:DELETE=29,cinder:UPDATE=287,cinder:SELECT=178,cinder:INSERT=60 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.921s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.734s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f39fbe-6188-4785-8850-1022b2be87d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c548752f-cc39-4b65-b4ce-a82965a98822', 'volume_size': 1, 'source_volid': 'cba793be-bc79-4641-b03e-54b2a8631160', 'source_volstatus': 'available'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffe90b9-1c78-4192-bb4e-86503ccb9da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] Creating offline snapshot 46357ef3-c10e-4d48-a284-88e2b81a81f9 of volume 69fd73e2-2904-4ce1-a47b-e2499bc07461 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:56:28 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Volume volume-c548752f-cc39-4b65-b4ce-a82965a98822 (c548752f-cc39-4b65-b4ce-a82965a98822): created successfully
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffe90b9-1c78-4192-bb4e-86503ccb9da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Flow 'volume_create_manager' (03aa7ee8-69fb-4ee5-9b74-6d02bb16267f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d5f284-f3b0-4651-ac2e-192cf7cc9f0e]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:28 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:28 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7cc8f645-98d4-4e41-824a-7d93d2ad4a1c tempest-VolumeDependencyTests-661061709 None] Created volume successfully.
Apr 16 19:56:28 devstack sudo[91198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461
Apr 16 19:56:28 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:29 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461" returned: 0 in 0.499s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:29 devstack sudo[91203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9 1G
Apr 16 19:56:29 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-cba793be-bc79-4641-b03e-54b2a8631160-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-cba793be-bc79-4641-b03e-54b2a8631160-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-quobyte-cba793be-bc79-4641-b03e-54b2a8631160" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:29 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-cba793be-bc79-4641-b03e-54b2a8631160" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:29 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a610d5f-2478-465a-99d6-43454453878d]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:29 devstack sudo[91205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160
Apr 16 19:56:29 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:29 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9 1G" returned: 0 in 0.499s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:29 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:29 devstack sudo[91211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9
Apr 16 19:56:29 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:30 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160" returned: 0 in 0.509s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:30 devstack sudo[91216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160
Apr 16 19:56:30 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:30 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9" returned: 0 in 0.439s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:30 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9 is being set with open permissions: ugo+rw
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:30 devstack sudo[91221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9
Apr 16 19:56:30 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:30 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-cba793be-bc79-4641-b03e-54b2a8631160" returned: 0 in 0.429s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-cba793be-bc79-4641-b03e-54b2a8631160" released by "delete_volume" :: held 0.967s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Created reservations ['98e902b9-7bba-4b6a-a71e-9c7e43705fbd', '03e115de-aced-4997-9c81-db0b14e006f6', '67dfed43-1499-4b63-a96e-b7ae39c76afa', '967e3eaa-fc78-472d-9712-e8409717395c'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-c548752f-cc39-4b65-b4ce-a82965a98822-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:30 devstack sudo[91224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:30 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-c548752f-cc39-4b65-b4ce-a82965a98822-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-quobyte-c548752f-cc39-4b65-b4ce-a82965a98822" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-c548752f-cc39-4b65-b4ce-a82965a98822" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f47bd88-432d-4f3f-b530-dc83e223a9c0]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:30 devstack sudo[91226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822
Apr 16 19:56:30 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:30 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9" returned: 0 in 0.434s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:30 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:30 devstack sudo[91229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.info
Apr 16 19:56:30 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:31 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.452s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:31 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Deleted volume successfully.
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-46975343-6737-4c15-87a2-0efef91db044 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-cba793be-bc79-4641-b03e-54b2a8631160-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:31 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822" returned: 0 in 0.487s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:31 devstack sudo[91242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822
Apr 16 19:56:31 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:31 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.info" returned: 0 in 0.437s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:31 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.info is being set with open permissions: ugo+rw
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:31 devstack sudo[91244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.info
Apr 16 19:56:31 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:31 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-c548752f-cc39-4b65-b4ce-a82965a98822" returned: 0 in 0.435s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-c548752f-cc39-4b65-b4ce-a82965a98822" released by "delete_volume" :: held 0.953s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Created reservations ['1c9f72b5-6b8c-4514-b64e-75137f83f8f2', '017bb6e1-4477-4846-9ccd-5c80ec1a5a86', '1fbb608d-ede7-4c5e-bbee-30c7c3abd331', '3f49dbcd-4acd-4587-91fe-48640cdfaba9'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:31 devstack sudo[91248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:31 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:31 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.info" returned: 0 in 0.454s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.836s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.552s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] Creating offline snapshot eb093542-181e-4c29-b7ed-79618c5cd6e9 of volume 5649d11c-8675-44f7-943c-e551efdadb34 {{(pid=82616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4326b6e-927a-481f-b395-ff5a6ec51512]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:31 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-72472e01-41b2-40a6-9e31-fe9bd283fc98 tempest-SnapshotDependencyTests-2035122597 None] Create snapshot completed successfully
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-10821c09-8749-4ab6-8c38-5dbc0661ecbe-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-10821c09-8749-4ab6-8c38-5dbc0661ecbe-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "cinder-quobyte-10821c09-8749-4ab6-8c38-5dbc0661ecbe" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-10821c09-8749-4ab6-8c38-5dbc0661ecbe" acquired by "delete_volume" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ed3153-bb26-4e60-b2fb-e09d20264e52]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:31 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:31 devstack sudo[91250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34
Apr 16 19:56:31 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:31 devstack sudo[91252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe
Apr 16 19:56:31 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:32 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.435s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:32 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Deleted volume successfully.
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-ff66851a-ae6c-4a33-9a51-5ce80f7f9d51 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-c548752f-cc39-4b65-b4ce-a82965a98822-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:32 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34" returned: 0 in 0.488s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9 1G {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:32 devstack sudo[91260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9 1G
Apr 16 19:56:32 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:32 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe" returned: 0 in 0.500s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:32 devstack sudo[91263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe
Apr 16 19:56:32 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:32 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9 1G" returned: 0 in 0.522s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5649d11c-8675-44f7-943c-e551efdadb34 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:32 devstack sudo[91269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5649d11c-8675-44f7-943c-e551efdadb34 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9
Apr 16 19:56:32 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:32 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-10821c09-8749-4ab6-8c38-5dbc0661ecbe" returned: 0 in 0.501s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-quobyte-10821c09-8749-4ab6-8c38-5dbc0661ecbe" released by "delete_volume" :: held 1.023s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Created reservations ['3865fa30-2d6b-4e57-8d03-6acbaf5c7660', '28f184bd-fa5e-478f-b0f9-66bc0c5136e4', 'bf4fbb1b-b2bf-4e93-a36a-a51e33b3511a', 'afa80ff8-d2a8-4e5f-bbb6-b3aa72b88956'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.volume.flows.manager.create_volume [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:32 devstack sudo[91271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:32 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Flow 'volume_create_manager' (9db8f891-f8cf-4471-acea-b43bd6b2f3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff859921-0243-43ea-83c7-5debd776eebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff859921-0243-43ea-83c7-5debd776eebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T17:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3ae808-f1da-4186-ba55-d90a3aae9627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6cbc11b0004b6eb9cda918451e74ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46357ef3-c10e-4d48-a284-88e2b81a81f9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:56:33Z,use_quota=True,user_id='85539614ab874d4dbdf95f039123fd99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(473244a5-ec40-4ec9-ab3f-b1e7432e5d46),volume_type_id=473244a5-ec40-4ec9-ab3f-b1e7432e5d46)' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b4b154-a8b0-4685-bbc0-cc336212988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b4b154-a8b0-4685-bbc0-cc336212988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cc8950-9b46-4ca0-8d62-8b77e5c401e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cc8950-9b46-4ca0-8d62-8b77e5c401e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9d3ae808-f1da-4186-ba55-d90a3aae9627', 'volume_name': 'volume-9d3ae808-f1da-4186-ba55-d90a3aae9627', 'volume_size': 1, 'snapshot_id': '46357ef3-c10e-4d48-a284-88e2b81a81f9'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8658513d-5188-4256-adab-fa08c545177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:32 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8658513d-5188-4256-adab-fa08c545177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:33 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba53a4d8-2548-42f7-b433-7828c7130b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:33 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Volume 9d3ae808-f1da-4186-ba55-d90a3aae9627: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9d3ae808-f1da-4186-ba55-d90a3aae9627', 'volume_size': 1, 'snapshot_id': '46357ef3-c10e-4d48-a284-88e2b81a81f9'}
Apr 16 19:56:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:33 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5649d11c-8675-44f7-943c-e551efdadb34 -F qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9" returned: 0 in 0.490s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:33 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9 is being set with open permissions: ugo+rw
Apr 16 19:56:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:33 devstack sudo[91276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9
Apr 16 19:56:33 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:33 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.408s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:33 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:33 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Deleted volume successfully.
Apr 16 19:56:33 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-7a2c37d1-b58a-4643-b99c-78b39aa44ff5 tempest-VolumeDependencyTests-661061709 None] Lock "cinder-10821c09-8749-4ab6-8c38-5dbc0661ecbe-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:33 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9" returned: 0 in 0.409s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:33 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:33 devstack sudo[91280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.info
Apr 16 19:56:33 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:34 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.info" returned: 0 in 0.432s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:34 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.info is being set with open permissions: ugo+rw
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.info {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:34 devstack sudo[91283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.info
Apr 16 19:56:34 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:34 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.info" returned: 0 in 0.473s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.876s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.592s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "cinder-quobyte-46357ef3-c10e-4d48-a284-88e2b81a81f9-9d3ae808-f1da-4186-ba55-d90a3aae9627" by "_create_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-quobyte-46357ef3-c10e-4d48-a284-88e2b81a81f9-9d3ae808-f1da-4186-ba55-d90a3aae9627" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Creating volume 9d3ae808-f1da-4186-ba55-d90a3aae9627 from snapshot 46357ef3-c10e-4d48-a284-88e2b81a81f9 {{(pid=82616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Selected osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de as target Quobyte volume. {{(pid=82616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "cinder-quobyte-9d3ae808-f1da-4186-ba55-d90a3aae9627" by "_copy_volume_from_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:34 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-ee99489e-619f-4dc0-9b7a-61cba46a84d3 tempest-CinderUnicodeTest-2000663133 None] Create snapshot completed successfully
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-quobyte-9d3ae808-f1da-4186-ba55-d90a3aae9627" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] snapshot: 46357ef3-c10e-4d48-a284-88e2b81a81f9, volume: 9d3ae808-f1da-4186-ba55-d90a3aae9627,  {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c849123b-bde8-42af-9c95-1db8079b6fbc]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:34 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:34 devstack sudo[91287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9
Apr 16 19:56:34 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:35 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9" returned: 0 in 0.495s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69fd73e2-2904-4ce1-a47b-e2499bc07461(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Creating direct copy from snapshot {{(pid=82616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[11535065-25f0-4c53-b9a1-a85b48d0851a]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:35 devstack sudo[91293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461
Apr 16 19:56:35 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "cinder-eb093542-181e-4c29-b7ed-79618c5cd6e9-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-eb093542-181e-4c29-b7ed-79618c5cd6e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "cinder-quobyte-5649d11c-8675-44f7-943c-e551efdadb34" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-quobyte-5649d11c-8675-44f7-943c-e551efdadb34" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "cinder-quobyte-eb093542-181e-4c29-b7ed-79618c5cd6e9" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-quobyte-eb093542-181e-4c29-b7ed-79618c5cd6e9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:35 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Deleting offline snapshot eb093542-181e-4c29-b7ed-79618c5cd6e9 of volume 5649d11c-8675-44f7-943c-e551efdadb34 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] snapshot_file for this snap is: volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461" returned: 0 in 0.509s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG cinder.utils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Path /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627 not found in is_blk_device check {{(pid=82616) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[34758aa0-e268-4d22-9ec8-2a4ca08f91ef]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:35 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:35 devstack sudo[91298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627
Apr 16 19:56:35 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:35 devstack sudo[91299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9
Apr 16 19:56:35 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:36 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9" returned: 0 in 0.657s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:36 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5649d11c-8675-44f7-943c-e551efdadb34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:56:36 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f079d6-6c4f-48e0-b4d4-97bfb25091ba]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:36 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:36 devstack sudo[91315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34
Apr 16 19:56:36 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:37 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34" returned: 0 in 1.279s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:37 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627" returned: 0 in 1.989s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:37 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03edd93-6ef1-432b-87b2-865ec08be9cf]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:37 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:37 devstack sudo[91320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9
Apr 16 19:56:37 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:37 devstack sudo[91322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461
Apr 16 19:56:37 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:38 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9" returned: 0 in 0.439s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:38 devstack sudo[91329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9
Apr 16 19:56:38 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:38 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461" returned: 0 in 0.631s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.image.image_utils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461, size 1024.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627 {{(pid=82616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 19:56:38 devstack cinder-volume[82616]: INFO cinder.image.image_utils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Converted 1024.00 MB image at 514.55 MB/s
Apr 16 19:56:38 devstack cinder-volume[82616]: WARNING cinder.volume.drivers.remotefs [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627 is being set with open permissions: ugo+rw
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:38 devstack sudo[91332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627
Apr 16 19:56:38 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:38 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34.eb093542-181e-4c29-b7ed-79618c5cd6e9" returned: 0 in 0.415s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-quobyte-eb093542-181e-4c29-b7ed-79618c5cd6e9" released by "_delete_snapshot" :: held 2.864s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-quobyte-5649d11c-8675-44f7-943c-e551efdadb34" released by "delete_snapshot" :: held 2.876s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Created reservations ['a2b0ad0a-54cc-4cb7-b555-789bb5a4021c', '7b83b825-d3a3-4560-9cb9-1cf78fbf89a3', '4e9a5046-d114-40fe-b328-6b4c2aec959e', 'a8337bdc-67f2-40f3-aff0-4948b564aad5'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:38 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Delete snapshot completed successfully.
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8bca0611-9cf3-4951-b62b-0d7bda0d181c tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-eb093542-181e-4c29-b7ed-79618c5cd6e9-delete_snapshot" released by "delete_snapshot" :: held 2.970s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:38 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627" returned: 0 in 0.421s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-quobyte-9d3ae808-f1da-4186-ba55-d90a3aae9627" released by "_copy_volume_from_snapshot" :: held 4.104s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-quobyte-46357ef3-c10e-4d48-a284-88e2b81a81f9-9d3ae808-f1da-4186-ba55-d90a3aae9627" released by "_create_volume_from_snapshot" :: held 4.125s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.143s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba53a4d8-2548-42f7-b433-7828c7130b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d3ae808-f1da-4186-ba55-d90a3aae9627', 'volume_size': 1, 'snapshot_id': '46357ef3-c10e-4d48-a284-88e2b81a81f9'}' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4eb24ed-36b3-4483-ba28-4a1d98bf01e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 19:56:38 devstack cinder-volume[82616]: INFO cinder.volume.flows.manager.create_volume [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Volume volume-9d3ae808-f1da-4186-ba55-d90a3aae9627 (9d3ae808-f1da-4186-ba55-d90a3aae9627): created successfully
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4eb24ed-36b3-4483-ba28-4a1d98bf01e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82616) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Flow 'volume_create_manager' (9db8f891-f8cf-4471-acea-b43bd6b2f3f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82616) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 19:56:38 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-55678b91-975a-49e0-a29f-d72ad767fa76 tempest-SnapshotDependencyTests-2035122597 None] Created volume successfully.
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "cinder-5649d11c-8675-44f7-943c-e551efdadb34-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-5649d11c-8675-44f7-943c-e551efdadb34-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "cinder-quobyte-5649d11c-8675-44f7-943c-e551efdadb34" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-quobyte-5649d11c-8675-44f7-943c-e551efdadb34" acquired by "delete_volume" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a451e358-d19f-44f8-80f3-6de0eef77e08]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:38 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:38 devstack sudo[91336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34
Apr 16 19:56:38 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "cinder-46357ef3-c10e-4d48-a284-88e2b81a81f9-delete_snapshot" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-46357ef3-c10e-4d48-a284-88e2b81a81f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "cinder-quobyte-69fd73e2-2904-4ce1-a47b-e2499bc07461" by "delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-quobyte-69fd73e2-2904-4ce1-a47b-e2499bc07461" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "cinder-quobyte-46357ef3-c10e-4d48-a284-88e2b81a81f9" by "_delete_snapshot" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-quobyte-46357ef3-c10e-4d48-a284-88e2b81a81f9" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Deleting offline snapshot 46357ef3-c10e-4d48-a284-88e2b81a81f9 of volume 69fd73e2-2904-4ce1-a47b-e2499bc07461 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] snapshot_file for this snap is: volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9 {{(pid=82616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d974cf8-b68f-4d63-9767-b13350b8903f]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:39 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34" returned: 0 in 0.505s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:39 devstack sudo[91342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34
Apr 16 19:56:39 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:39 devstack sudo[91341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9
Apr 16 19:56:39 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:39 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-5649d11c-8675-44f7-943c-e551efdadb34" returned: 0 in 0.410s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-quobyte-5649d11c-8675-44f7-943c-e551efdadb34" released by "delete_volume" :: held 0.947s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Created reservations ['4eea3f48-8158-4b12-9c62-00b1b1fa31bb', 'bf179edc-2ed7-48e8-bae7-86df73323872', '0d2ebdbd-79be-4bbc-983a-a3e7df6bd016', '14ba1cb6-51e9-4fed-bd49-72877780afe9'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:39 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9" returned: 0 in 0.530s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.remotefs [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69fd73e2-2904-4ce1-a47b-e2499bc07461(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8404050a-c2a8-4b64-a0f7-b4451fe13703]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:39 devstack sudo[91349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:39 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "cinder-19fa4ec9-5c89-4dd8-b9de-caed000c3b90-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-19fa4ec9-5c89-4dd8-b9de-caed000c3b90-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:39 devstack sudo[91351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461
Apr 16 19:56:39 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "cinder-quobyte-19fa4ec9-5c89-4dd8-b9de-caed000c3b90" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:39 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-quobyte-19fa4ec9-5c89-4dd8-b9de-caed000c3b90" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda9369d-f2c2-4ddd-8b30-6ca6a51451c9]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:40 devstack sudo[91353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90
Apr 16 19:56:40 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:40 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.453s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:40 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Deleted volume successfully.
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-8beb3e60-4009-45a1-80b5-8325d8dd83bc tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-5649d11c-8675-44f7-943c-e551efdadb34-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:40 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461" returned: 0 in 0.500s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:40 devstack sudo[91361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9
Apr 16 19:56:40 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:40 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90" returned: 0 in 0.489s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:40 devstack sudo[91364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90
Apr 16 19:56:40 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:40 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9" returned: 0 in 0.463s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:40 devstack sudo[91370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9
Apr 16 19:56:40 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:40 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-19fa4ec9-5c89-4dd8-b9de-caed000c3b90" returned: 0 in 0.408s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-quobyte-19fa4ec9-5c89-4dd8-b9de-caed000c3b90" released by "delete_volume" :: held 0.917s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Created reservations ['8f05a787-fd20-4bbe-adca-c478ddf49d79', 'cb2981e4-220b-4f7b-993d-a194c30b9a1f', '807ccd48-b4f0-455b-b430-5a6e8b55a1fc', 'b0c701b3-03a6-4d5c-9602-a87072e8d64b'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:40 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:41 devstack sudo[91372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:41 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:41 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461.46357ef3-c10e-4d48-a284-88e2b81a81f9" returned: 0 in 0.447s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:41 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-quobyte-46357ef3-c10e-4d48-a284-88e2b81a81f9" released by "_delete_snapshot" :: held 1.998s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:41 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-quobyte-69fd73e2-2904-4ce1-a47b-e2499bc07461" released by "delete_snapshot" :: held 2.008s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:41 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Created reservations ['41148175-ffcb-4d52-b269-a69dc45d680c', '0b8590e6-76e5-4be1-b6a9-083ab9d3b785', 'd3052726-f09e-4bbe-9451-206d370037b4', 'a36d64b6-4164-409d-ab7e-39c3a2b6a2a4'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:41 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Delete snapshot completed successfully.
Apr 16 19:56:41 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-5c72c4e6-185b-43de-a89d-bbd9e294588f tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-46357ef3-c10e-4d48-a284-88e2b81a81f9-delete_snapshot" released by "delete_snapshot" :: held 2.103s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:41 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:41 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.483s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:41 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:41 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Deleted volume successfully.
Apr 16 19:56:41 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-08d099ed-a061-4f91-986d-3b955f5e635a tempest-CinderUnicodeTest-2000663133 None] Lock "cinder-19fa4ec9-5c89-4dd8-b9de-caed000c3b90-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "cinder-69fd73e2-2904-4ce1-a47b-e2499bc07461-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-69fd73e2-2904-4ce1-a47b-e2499bc07461-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "cinder-quobyte-69fd73e2-2904-4ce1-a47b-e2499bc07461" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:42 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-quobyte-69fd73e2-2904-4ce1-a47b-e2499bc07461" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:42 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[82823e61-063f-4e7c-92d4-b0085ab19190]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:42 devstack sudo[91376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461
Apr 16 19:56:42 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:42 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461" returned: 0 in 0.459s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:42 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:42 devstack sudo[91381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461
Apr 16 19:56:42 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:43 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-69fd73e2-2904-4ce1-a47b-e2499bc07461" returned: 0 in 0.399s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-quobyte-69fd73e2-2904-4ce1-a47b-e2499bc07461" released by "delete_volume" :: held 0.893s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Created reservations ['6e2349d3-9c56-464b-a270-cf53e1e0b24e', '75a980ca-0d75-45ef-9ddf-3d0340ded734', 'ea303401-718b-4553-89a8-6e32e9b29d79', '9b913011-8414-4877-bb15-c7468766202c'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:43 devstack sudo[91384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:43 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "cinder-9d3ae808-f1da-4186-ba55-d90a3aae9627-delete_volume" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-9d3ae808-f1da-4186-ba55-d90a3aae9627-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "cinder-quobyte-9d3ae808-f1da-4186-ba55-d90a3aae9627" by "delete_volume" {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-quobyte-9d3ae808-f1da-4186-ba55-d90a3aae9627" acquired by "delete_volume" :: waited 0.007s {{(pid=82616) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG oslo.privsep.daemon [-] privsep: reply[24115baf-5555-47d4-bab1-d3586c3e638e]: (4, 'qcow2') {{(pid=83524) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:43 devstack sudo[91386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627
Apr 16 19:56:43 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:43 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.457s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:43 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Deleted volume successfully.
Apr 16 19:56:43 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-88f12461-8633-471b-8b6d-c8f933870122 tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-69fd73e2-2904-4ce1-a47b-e2499bc07461-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:44 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627" returned: 0 in 0.470s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:44 devstack sudo[91392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627
Apr 16 19:56:44 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:44 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730/volume-9d3ae808-f1da-4186-ba55-d90a3aae9627" returned: 0 in 0.411s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:44 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-quobyte-9d3ae808-f1da-4186-ba55-d90a3aae9627" released by "delete_volume" :: held 0.902s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:44 devstack cinder-volume[82616]: DEBUG cinder.quota [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Created reservations ['5bb35893-588b-4500-b7b8-dd678e3cc6e3', 'a271ef54-37a9-452b-b7a6-c55f28c182c5', 'd447981a-cd58-421b-ab47-c2cf648c2574', 'a5563f57-2abf-4a32-8a18-59c344a30525'] {{(pid=82616) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 19:56:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 19:56:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 19:56:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de': None} {{(pid=82616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 19:56:44 devstack cinder-volume[82616]: DEBUG cinder.volume.drivers.quobyte [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f82a3495-b1f4-4501-8368-b0666df4c7de'] {{(pid=82616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 19:56:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.lockutils [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82616) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 19:56:44 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730 {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 19:56:44 devstack sudo[91395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730
Apr 16 19:56:44 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 19:56:45 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root
Apr 16 19:56:45 devstack cinder-volume[82616]: DEBUG oslo_concurrency.processutils [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d9e19cb946327442d7e17ef15a32730" returned: 0 in 0.421s {{(pid=82616) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 19:56:45 devstack cinder-volume[82616]: DEBUG cinder.manager [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Notifying Schedulers of capabilities ... {{(pid=82616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 19:56:45 devstack cinder-volume[82616]: INFO cinder.volume.manager [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Deleted volume successfully.
Apr 16 19:56:45 devstack cinder-volume[82616]: DEBUG cinder.coordination [None req-b6b4e77d-bd7b-4a26-afa8-390fc8a43213 tempest-SnapshotDependencyTests-2035122597 None] Lock "cinder-9d3ae808-f1da-4186-ba55-d90a3aae9627-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=82616) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 19:56:54 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:SELECT=55,cinder:UPDATE=64,cinder:DELETE=6,cinder:INSERT=15 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 19:56:55 devstack cinder-volume[82616]: DEBUG dbcounter [-] [82616] Writing DB stats cinder:UPDATE=83,cinder:SELECT=56,cinder:INSERT=24,cinder:DELETE=5 {{(pid=82616) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}